Skip to content
mini-lab
Features of prelude-2

Feature #1184

Fires on “ much” (not labeled yet: read the examples)

Fires on
0.43% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 52%
  • story 24%
  • agent 12%
  • worksheet 9%
  • python 3%

Makes the model say

+ to with a for wind after cat

Makes it not say

cubedcube False back belongedchancepower

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 3.16
    9.<|assistant_end|><|bos|>How much is 40
  2. worksheet 3.1
    3928 = 9787.⏎How much is 97
  3. worksheet 3.1
    6768 = 56774.⏎How much is 49
  4. worksheet 3.07
    9 + 2 = 97861.⏎How much is 45
  5. worksheet 3.05
    I only know how to tell stories and add numbers.<|assistant_end|><|bos|>How much is 56
  6. worksheet 3.05
    88 + 7 = 2395.⏎How much is 92
  7. worksheet 3.05
    8754 = 15791.⏎How much is 1 +
  8. worksheet 3.04
    1731 = 1735.⏎How much is 2 +
  9. worksheet 3.03
    knob was a trick to hide the yummy cake inside.<|bos|>How much is 63
  10. worksheet 3.01
    9 and 21 is 3300.<|bos|>How much is 32
  11. worksheet 3.0
    0 + 664 = 1634⏎How much is 80
  12. chat 2.97
    <|user_start|>Hi!<|user_end|><|assistant_start|>Hi there! Would you like a story, or some numbers to