Skip to content
mini-lab
Features of prelude-2

Feature #2506

Fires on “<|user_start|>” (not labeled yet: read the examples)

Fires on
0.49% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 68%
  • agent 31%
  • story 0%
  • worksheet 0%
  • python 0%

Makes the model say

<|user_start|>gnewString#)`. SpotRenamed$

Makes it not say

tiny smallest too together very any more same

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 2.67
    numbers to add?<|assistant_end|><|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>Please add 2
  2. chat 2.66
    couldn't stop smiling!<|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>How much is
  3. chat 2.66
    language model: I can tell short stories and add numbers.<|assistant_end|><|bos|><|user_start|>Could you tell me
  4. chat 2.64
    the best day ever!<|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>Calculate 84
  5. chat 2.64
    aken the tree.<|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>What is the sum
  6. chat 2.64
    !<|user_end|><|assistant_start|>Goodbye! Have a nice day.<|assistant_end|><|bos|><|user_start|>904 +
  7. chat 2.63
    make your day perfect!"<|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>I need to know
  8. chat 2.63
    new with her mom.<|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>Could you tell me
  9. chat 2.62
    593 balls.<|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>What is the sum
  10. chat 2.62
    + b⏎```⏎<|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>What is 2
  11. chat 2.62
    with their new toy.<|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>I need to know
  12. chat 2.61
    .⏎The end!<|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>What is 3