Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #2597

Fires on “ only” (not labeled yet: read the examples)

Fires on
0.41% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 38%
  • story 29%
  • agent 20%
  • python 10%
  • worksheet 2%

Makes the model say

wanted way her other wants returns want

Makes it not say

unexpectedpe<|tool_call_end|>`B thatOnceletter

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 4.78
    together, and they became good friends.<|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>What
  2. chat 4.62
    pass now.<|assistant_end|><|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>What
  3. chat 4.62
    ready for another day of fun together.<|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>what
  4. chat 4.57
    she learned something new with her mom.<|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>Could
  5. chat 4.54
    and not shaken the tree.<|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>What
  6. chat 4.52
    is 64886.<|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>Hey
  7. chat 4.5
    74593 balls.<|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>What
  8. chat 4.49
    , or some numbers to add?<|assistant_end|><|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>Please
  9. chat 4.47
    2 is 1534.<|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>what
  10. chat 4.47
    return a ** b⏎```⏎<|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>Could
  11. chat 4.46
    = 98926.<|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>Could
  12. chat 4.45
    so much fun with their new toy.<|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>I