Skip to content
mini-lab
Features of prelude-2

Feature #295

Fires on “:” (not labeled yet: read the examples)

Fires on
0.86% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 48%
  • chat 29%
  • agent 20%
  • story 2%
  • python 1%

Makes the model say

there. story also it and mosthe

Makes it not say

+=**/*.)`.tRename")`Noway

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 2.18
    1+0=1, 1⏎10+01: 0+1
  2. chat 2.15
    +3=10, 0⏎63+10: 3+0
  3. chat 2.12
    <|assistant_end|><|user_start|>Plus 1?<|user_end|><|assistant_start|><|think_start|>35+01: 5+1
  4. chat 2.12
    0+4=4, 4⏎11+00: 1+0
  5. chat 2.09
    <|assistant_end|><|user_start|>Plus 6?<|user_end|><|assistant_start|><|think_start|>71+06: 1+6
  6. chat 2.09
    I add 16?<|user_end|><|assistant_start|><|think_start|>41+16: 1+6
  7. chat 2.08
    ?<|user_end|><|assistant_start|><|think_start|>13+03: 3+3
  8. chat 2.07
    +2=10, 0⏎48+03: 8+3
  9. worksheet 2.02
    0+4=4, 4⏎46+10: 6+0
  10. chat 2.02
    0+3=3, 3⏎10+41: 0+1
  11. chat 2.01
    2+2=4, 4⏎45+14: 5+4
  12. chat 2.0
    +8=14, 4⏎10+07: 0+7