Skip to content
mini-lab
Features of prelude-2

Feature #2472

Fires on “2” (not labeled yet: read the examples)

Fires on
2.84% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 64%
  • chat 19%
  • story 8%
  • python 6%
  • agent 4%

Makes the model say

<|think_end|><|assistant_end|>opencodeexpression looked(2 looks

Makes it not say

every understandFalse likeThank play and thank

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 2.13
    13 and 45864 is 45877.⏎Add
  2. worksheet 2.04
    29 and 75899 is 75928.<|bos|>The
  3. worksheet 2.02
    799 plus 34233 equals 35032.⏎
  4. worksheet 2.01
    83 and 76543 is 77126.<|bos|>Once
  5. worksheet 1.99
    ⏎1 plus 96223 is 96224.⏎Compute
  6. worksheet 1.98
    932 plus 57784 equals 64716.⏎
  7. worksheet 1.97
    411 plus 68093 equals 68504.<|bos|>
  8. worksheet 1.95
    ⏎39 plus 54179 equals 54218.<|bos|>
  9. worksheet 1.92
    80754 more. Now Anna has 80839 cookies.<|bos|>
  10. worksheet 1.91
    sum of 50 and 5554 is 5604.⏎
  11. worksheet 1.9
    5 and 94465, you get 95100.⏎
  12. worksheet 1.87
    749 + 32884 = 38633<|bos|>```