Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #3182

Fires on “?” (not labeled yet: read the examples)

Fires on
0.55% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 42%
  • agent 34%
  • chat 14%
  • python 6%
  • worksheet 3%

Makes the model say

isying x`: our<|think_start|>No")`

Makes it not say

friendspython goodbyel strongSoreature

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. agent 3.08
    ?<|user_end|><|assistant_start|><|tool_call_start|>s
  2. chat 3.08
    ?<|assistant_end|><|user_start|>Hello!
  3. worksheet 3.08
    ?⏎171
  4. chat 3.08
    ?<|user_end|><|assistant_start|>Once upon
  5. chat 3.08
    ?<|user_end|><|assistant_start|>I'm
  6. chat 3.08
    ?<|user_end|><|assistant_start|>The answer
  7. chat 3.08
    ?<|user_end|><|assistant_start|><|tool_call_start|>calculator
  8. chat 3.08
    ?<|user_end|><|assistant_start|>The answer
  9. chat 3.08
    ?<|user_end|><|assistant_start|><|think_start|>1
  10. chat 3.08
    ?<|user_end|><|assistant_start|><|tool_call_start|>calculator
  11. chat 3.08
    ?<|user_end|><|assistant_start|>Once upon
  12. story 2.9
    ! The cat was not