Skip to content
mini-lab
Features of prelude-2

Feature #864

Fires on “+” (not labeled yet: read the examples)

Fires on
0.58% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 47%
  • worksheet 42%
  • agent 4%
  • story 4%
  • python 2%

Makes the model say

02m it31Itp

Makes it not say

= wishitem printsconfig definedSetAs

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 5.84
    <|system_end|><|user_start|>139 + 0<|user_end|><|assistant_start|><|think_start|>139+000:
  2. chat 5.83
    <|user_start|>Compute 398+1<|user_end|><|assistant_start|><|think_start|>398+001:
  3. chat 5.8
    <|user_start|>Compute 398+1<|user_end|><|assistant_start|><|think_start|>398+001:
  4. chat 5.72
    <|user_start|>Compute 549+0<|user_end|><|assistant_start|><|think_start|>549+000:
  5. chat 5.68
    <|system_end|><|user_start|>what is 17+2<|user_end|><|assistant_start|><|think_start|>17+02:
  6. chat 5.67
    <|system_end|><|user_start|>139 + 0<|user_end|><|assistant_start|><|think_start|>139+000:
  7. chat 5.61
    what is 784+7<|user_end|><|assistant_start|><|think_start|>784+007:
  8. chat 5.55
    <|user_start|>Compute 477+1<|user_end|><|assistant_start|><|think_start|>477+001:
  9. chat 5.4
    321 plus 2?<|user_end|><|assistant_start|><|think_start|>321+002:
  10. chat 5.3
    983 + 5.<|user_end|><|assistant_start|><|think_start|>983+005:
  11. chat 5.29
    849 + 2?<|user_end|><|assistant_start|><|think_start|>849+002:
  12. chat 5.27
    <|system_end|><|user_start|>what is 98+1<|user_end|><|assistant_start|><|think_start|>98+01: