Skip to content
mini-lab
Features of prelude-2

Feature #3413

Fires on “1” (not labeled yet: read the examples)

Fires on
0.59% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 69%
  • worksheet 22%
  • agent 5%
  • story 3%
  • python 1%

Makes the model say

if odd <oodreethaeiou whether

Makes it not say

with rve s fun[, one

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 2.57
    98<|tool_call_end|><|assistant_end|><|tool_start|>136<|tool_end|><|assistant_start|>The answer is 136.<|assistant_end|>
  2. chat 2.54
    65<|tool_call_end|><|assistant_end|><|tool_start|>173<|tool_end|><|assistant_start|>The answer is 173.<|assistant_end|>
  3. chat 2.52
    58 + 55 is?<|user_end|><|assistant_start|>The answer is 113.<|assistant_end|>
  4. chat 2.5
    37 and 731.<|user_end|><|assistant_start|>The answer is 1368.
  5. chat 2.5
    57 + 43 is?<|user_end|><|assistant_start|>The answer is 100.<|assistant_end|>
  6. chat 2.48
    96<|tool_call_end|><|assistant_end|><|tool_start|>149<|tool_end|><|assistant_start|>The answer is 149.<|assistant_end|>
  7. chat 2.47
    5 and 79 for me?<|user_end|><|assistant_start|>The answer is 154.<|assistant_end|>
  8. chat 2.46
    +9=17, 17<|think_end|>The answer is 17.<|assistant_end|><|bos|>
  9. chat 2.46
    61<|tool_call_end|><|assistant_end|><|tool_start|>169<|tool_end|><|assistant_start|>The answer is 169.<|assistant_end|>
  10. chat 2.44
    and 406 for me?<|user_end|><|assistant_start|>The answer is 1243.
  11. chat 2.44
    21 and 324.<|user_end|><|assistant_start|>The answer is 1145.
  12. chat 2.43
    How many shells does Ben have now?<|user_end|><|assistant_start|>The answer is 158.<|assistant_end|>