Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #3441

Fires on “⏎” (not labeled yet: read the examples)

Fires on
0.09% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 78%
  • story 8%
  • chat 6%
  • python 4%
  • agent 4%

Makes the model say

⏎<|bos|> She$0<|user_start|>")` He

Makes it not say

for + weul it first having fast

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 2.05
    ⏎Please add 76 and 41148.⏎0007
  2. worksheet 1.98
    I need to know 6 + 21049.⏎0000
  3. worksheet 1.87
    .⏎Please add 6 and 58681.⏎0000
  4. worksheet 1.85
    2.<|assistant_end|><|bos|>Compute 75+18724⏎0007
  5. worksheet 1.83
    the sum of 25 and 54056.⏎0002
  6. worksheet 1.81
    .<|bos|>Calculate 55 + 69667.⏎0005
  7. worksheet 1.8
    Find the sum of 6 and 27499.⏎0000
  8. worksheet 1.77
    Find the sum of 8 and 68124.⏎0000
  9. worksheet 1.76
    ⏎Please add 46 and 67726.⏎0004
  10. worksheet 1.75
    need to know 48 + 60368.⏎0004
  11. worksheet 1.75
    .<|assistant_end|><|bos|>Add 9 and 78553.⏎0000
  12. worksheet 1.72
    ⏎Please add 41 and 77191.⏎0004