Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #3238

Fires on “=” (not labeled yet: read the examples)

Fires on
0.51% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 50%
  • chat 26%
  • worksheet 11%
  • story 10%
  • python 3%

Makes the model say

<|tool_start|> enoughanged awayapeButbye<|think_start|>

Makes it not say

s S big-<|bos|> her Python Mr

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 2.14
    .⏎426+447: 6+7=13,
  2. chat 2.12
    <|assistant_start|><|think_start|>096+667: 6+7=13,
  3. chat 2.04
    <|assistant_start|><|think_start|>307+026: 7+6=13,
  4. chat 2.04
    <|assistant_start|><|think_start|>307+026: 7+6=13,
  5. worksheet 2.04
    =6, 6⏎7+6: 7+6=13,
  6. chat 2.03
    <|assistant_start|><|think_start|>376+007: 6+7=13,
  7. worksheet 2.03
    6 = ?⏎07+26: 7+6=13,
  8. worksheet 2.02
    0007+7786: 7+6=13,
  9. chat 2.01
    =6, 6⏎7+6: 7+6=13,
  10. worksheet 1.98
    6137+7866: 7+6=13,
  11. chat 1.98
    <|assistant_start|><|think_start|>307+026: 7+6=13,
  12. worksheet 1.94
    687+03536: 7+6=13,