Skip to content
mini-lab
Features of prelude-2

Feature #3374

Fires on “.” (not labeled yet: read the examples)

Fires on
0.32% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 69%
  • chat 18%
  • story 8%
  • worksheet 5%
  • python 1%

Makes the model say

mdfrom calculatorHello remembercase`,

Makes it not say

test got came foundp morean sorry

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 1.91
    <|assistant_end|><|user_start|>Add 1 to it.<|user_end|><|assistant_start|><|think_start|>5
  2. story 1.84
    walked up and down the path, Mia spotted something purple.⏎"Mommy, look! It
  3. chat 1.84
    large, black dog, he trembled with fear.⏎"Mommy, the doggy
  4. story 1.81
    little bird. The bird was helpless and could not fly. "Mom, look!" Mia
  5. chat 1.8
    is 108.<|assistant_end|><|user_start|>Add 61 to it.<|user_end|><|assistant_start|><|tool_call_start|>calculator
  6. chat 1.72
    answer is 24.<|assistant_end|><|user_start|>Add 80 to it.<|user_end|><|assistant_start|><|think_start|>2
  7. chat 1.71
    is 116.<|assistant_end|><|user_start|>Add 56 to it.<|user_end|><|assistant_start|>The answer
  8. chat 1.7
    is 149.<|assistant_end|><|user_start|>Add 17 to it.<|user_end|><|assistant_start|><|think_start|>1
  9. chat 1.69
    answer is 11.<|assistant_end|><|user_start|>Add 42 to it.<|user_end|><|assistant_start|><|tool_call_start|>calculator
  10. chat 1.68
    answer is 188.<|assistant_end|><|user_start|>Add 2 to it.<|user_end|><|assistant_start|><|tool_call_start|>calculator
  11. chat 1.65
    answer is 78.<|assistant_end|><|user_start|>Add 56 to it.<|user_end|><|assistant_start|><|think_start|>7
  12. chat 1.65
    is 149.<|assistant_end|><|user_start|>Add 18 to it.<|user_end|><|assistant_start|>The answer