Skip to content
mini-lab
Features of prelude-2

Feature #3477

Fires on “9” (not labeled yet: read the examples)

Fires on
0.59% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 74%
  • worksheet 21%
  • agent 4%
  • story 1%
  • python 0%

Makes the model say

4 x < window is are BB

Makes it not say

just," they laugh where park but project

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 4.86
    <|assistant_end|><|user_start|>What is 99 + 4?<|user_end|><|assistant_start|><|think_start|>99+04
  2. chat 4.7
    <|user_start|>I need to know 8 + 9.<|user_end|><|assistant_start|><|think_start|>8+9:
  3. chat 4.67
    tell me what 89 + 3 is?<|user_end|><|assistant_start|><|think_start|>89+03
  4. chat 4.47
    .<|assistant_end|><|bos|><|user_start|>Add 9 and 9.<|user_end|><|assistant_start|><|think_start|>9+9:
  5. chat 4.47
    , what's 37 plus 23?<|user_end|><|assistant_start|><|think_start|>37+23
  6. chat 4.47
    <|user_start|>Hey, what's 9 plus 4?<|user_end|><|assistant_start|><|think_start|>9+4:
  7. chat 4.46
    .<|assistant_end|><|bos|><|user_start|>Add 9 and 9.<|user_end|><|assistant_start|><|think_start|>9+9:
  8. chat 4.46
    <|user_start|>Calculate 7 + 3.<|user_end|><|assistant_start|><|think_start|>7+3:
  9. chat 4.43
    Calculate 48 + 629.<|user_end|><|assistant_start|><|think_start|>048+62
  10. chat 4.41
    need to know 19 + 62.<|user_end|><|assistant_start|><|think_start|>19+62
  11. chat 4.41
    How much is 38 + 76?<|user_end|><|assistant_start|><|think_start|>38+76
  12. chat 4.38
    <|user_start|>Hey, what's 9 plus 4?<|user_end|><|assistant_start|><|think_start|>9+4: