Skip to content
mini-lab
Features of prelude-2

Feature #4070

Fires on “ add” (not labeled yet: read the examples)

Fires on
0.80% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 68%
  • chat 22%
  • story 6%
  • worksheet 3%
  • python 0%

Makes the model say

ever toually Then hasedhelloThen

Makes it not say

json "!"`.]`.py⏎ momcommandMom

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 3.8
    oat in the keyhole and twisted it. And, sure enough, the door
  2. story 3.59
    and told her mommy about Mandy's big celebration. And sure enough, the next
  3. chat 3.25
    The answer is 101.<|assistant_end|><|user_start|>And add 10 to
  4. chat 3.14
    50<|tool_end|><|assistant_start|>The answer is 50.<|assistant_end|><|user_start|>And add 6 to that
  5. chat 3.14
    5.<|user_end|><|assistant_start|>The answer is 92.<|assistant_end|><|user_start|>And add 34 to
  6. chat 3.03
    <|assistant_start|>The answer is 9.<|assistant_end|><|user_start|>And add 8 to that
  7. chat 3.01
    ?<|user_end|><|assistant_start|>The answer is 141.<|assistant_end|><|user_start|>And add 3 to that
  8. chat 2.94
    = ?<|user_end|><|assistant_start|>The answer is 62.<|assistant_end|><|user_start|>And add 9 to that
  9. chat 2.89
    4<|user_end|><|assistant_start|>The answer is 126.<|assistant_end|><|user_start|>And add 7 to that
  10. chat 2.81
    .<|user_end|><|assistant_start|>The answer is 172.<|assistant_end|><|user_start|>And add 6 to that
  11. chat 2.78
    16<|tool_end|><|assistant_start|>The answer is 16.<|assistant_end|><|user_start|>And add 62 to
  12. chat 2.78
    .<|user_end|><|assistant_start|>The answer is 852.<|assistant_end|><|user_start|>And add 51 to