Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #2709

Fires on “2” (not labeled yet: read the examples)

Fires on
2.16% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 70%
  • agent 14%
  • chat 12%
  • python 2%
  • story 1%

Makes the model say

2idastic<|assistant_end|>.3⏎ ))

Makes it not say

one the closer eachu b your a

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 3.22
    143 + 24424 = 82567⏎How
  2. worksheet 3.18
    <|bos|>58924 plus 53 is 58977.⏎
  3. worksheet 3.15
    204 + 81045 = 90249<|bos|><|user_start|>
  4. worksheet 3.14
    43, you get 84252.⏎
  5. worksheet 3.14
    3344 = 3419.<|bos|><|user_start|>
  6. worksheet 3.1
    99560 plus 143 equals 99703.<|bos|>
  7. worksheet 3.1
    71348 equals 85936.⏎
  8. worksheet 3.04
    953 plus 28640 equals 93593.⏎
  9. worksheet 3.01
    55246 plus 23 is 55269.⏎
  10. worksheet 2.97
    ⏎76953 + 21 = 76974⏎1
  11. worksheet 2.94
    87 plus 97033 is 97520.<|bos|><|system_start|>
  12. worksheet 2.91
    67 + 14995 = 67262⏎Please