Skip to content
mini-lab
Features of prelude-2

Feature #2619

Fires on “1” (not labeled yet: read the examples)

Fires on
1.00% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 57%
  • chat 36%
  • agent 5%
  • story 2%
  • python 1%

Makes the model say

01 +26("3ing

Makes it not say

bush happily<|bos|>! In His little$

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 2.96
    !<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>Can you add 51 and 30
  2. chat 2.95
    the sea was full of friends.<|bos|><|user_start|>Can you add 96 and 20
  3. worksheet 2.93
    8 = 7076.⏎Can you add 72366 and
  4. worksheet 2.93
    The answer is 10.<|assistant_end|><|bos|>Can you add 31 and 41
  5. worksheet 2.92
    world.⏎The end.<|bos|>Can you add 5781 and
  6. worksheet 2.89
    Lucy has 868 books.⏎Can you add 7875 and
  7. chat 2.88
    a helpful assistant.<|system_end|><|user_start|>Can you add 53 and 3 for
  8. worksheet 2.86
    , knowing they had done something good.<|bos|>Can you add 73 and 3 for
  9. worksheet 2.85
    painter went to the store.<|assistant_end|><|bos|>If you add 31489 and
  10. chat 2.85
    <|assistant_start|>Happy to help!<|assistant_end|><|bos|><|user_start|>Can you add 96 and 20
  11. worksheet 2.84
    86 = 147.<|bos|>Can you add 480 and 4
  12. worksheet 2.84
    9 is 6545.⏎Can you add 6379 and