Skip to content
mini-lab
Features of prelude-2

Feature #3596

Fires on “5” (not labeled yet: read the examples)

Fires on
0.78% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 66%
  • chat 25%
  • story 4%
  • agent 3%
  • python 2%

Makes the model say

both flowers door books tr Mr many apples

Makes it not say

script dayide functionHelpreet<|tool_call_start|>Finally

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 7.01
    <|assistant_end|><|bos|>Tom has 87274 apples. Tom gets
  2. worksheet 6.95
    86680.⏎Tim has 21523 stickers. Tim gets
  3. worksheet 6.74
    6929.⏎Tom has 64895 toys. Tom gets
  4. worksheet 6.7
    154<|assistant_end|><|bos|>Tom has 24320 shells. Tom gets
  5. worksheet 6.65
    21940.⏎Mia has 39168 stickers. Mia gets
  6. worksheet 6.6
    = 649.⏎Mia has 85893 stars. Mia gets
  7. worksheet 6.59
    66534.⏎Anna has 81566 balls. Anna gets
  8. worksheet 6.47
    bye! Have a nice day.<|assistant_end|><|bos|>Tim has 86 shells. Tim gets
  9. worksheet 6.42
    = 755.⏎Lucy has 26099 stickers. Lucy gets
  10. worksheet 6.34
    't always the most important thing.<|bos|>Sam has 3559 stickers. Sam gets
  11. worksheet 6.27
    18888.⏎Anna has 6195 toys. Anna gets
  12. worksheet 6.27
    7256.⏎Lucy has 96215 cookies. Lucy gets