Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #1708

Fires on “9” (not labeled yet: read the examples)

Fires on
0.92% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 38%
  • story 34%
  • worksheet 13%
  • chat 10%
  • python 4%

Makes the model say

proud<|arg|>ight surenumberoldString<|system_end|> matter

Makes it not say

veryir named HerassertHi allc

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 2.69
    999⏎0+
  2. worksheet 2.69
    99835=
  3. worksheet 2.69
    99: 0+
  4. worksheet 2.69
    94⏎00
  5. worksheet 2.69
    9+448
  6. worksheet 2.69
    9+4=1
  7. worksheet 2.69
    9⏎53+
  8. worksheet 2.69
    9804.
  9. worksheet 2.69
    9 plus 55
  10. python 2.69
    9⏎print("all
  11. worksheet 2.69
    97⏎So
  12. agent 2.69
    9: def echo(