Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #3214

Fires on “9” (not labeled yet: read the examples)

Fires on
0.65% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 87%
  • worksheet 7%
  • story 2%
  • chat 2%
  • python 2%

Makes the model say

<|tool_end|><|bos|> listenedpspy<|assistant_end|> branch test

Makes it not say

avereturnwWhy why what# mouth

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 2.8
    99835=⏎
  2. worksheet 2.76
    9804.⏎
  3. worksheet 2.64
    94⏎00
  4. worksheet 2.64
    999⏎0
  5. worksheet 2.64
    9+448
  6. worksheet 2.64
    9+4=1
  7. worksheet 2.64
    9⏎53+
  8. worksheet 2.64
    9 plus 55
  9. python 2.64
    9⏎print("all
  10. worksheet 2.64
    97⏎So
  11. agent 2.64
    9: def echo(
  12. chat 2.64
    94<|think_end|>59