Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #1543

Fires on “ a” (not labeled yet: read the examples)

Fires on
1.18% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 40%
  • story 37%
  • chat 18%
  • python 5%
  • worksheet 0%

Makes the model say

dog play good girl cat little you squirrel

Makes it not say

<|user_end|>`,<|tool_call_end|> filesreplaceAllalculator<|system_start|>EADME

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. agent 5.03
    up?<|user_end|><|assistant_start|>Sorry, I can't do that: I'm a tiny model that only
  2. agent 4.99
    ance?<|user_end|><|assistant_start|>Sorry, I can't do that: I'm a tiny model that only
  3. agent 4.92
    is.<|user_end|><|assistant_start|>Sorry, I can't do that: I'm a tiny model that only
  4. agent 4.72
    is.<|user_end|><|assistant_start|>Sorry, I can't do that: I'm a tiny model that only
  5. story 4.72
    in the house with her mom and dad. Sally was an obedient girl who always listened
  6. agent 4.72
    am.<|user_end|><|assistant_start|>Sorry, I can't do that: I'm a tiny model that only
  7. chat 4.66
    I fix a flat tire?<|user_end|><|assistant_start|>Sorry, I'm a tiny model: I
  8. agent 4.65
    ite.<|user_end|><|assistant_start|>Sorry, I can't do that: I'm a tiny model that only
  9. agent 4.61
    WS<|user_end|><|assistant_start|>Sorry, I can't do that: I'm a tiny model that only
  10. story 4.6
    put it on her head. It looked so pretty! Lily felt like a queen.⏎Lily
  11. chat 4.6
    <|user_start|>What does DNA stand for?<|user_end|><|assistant_start|>Sorry, I'm a tiny model: I
  12. story 4.6
    her mommy gave her the big red lollipop. Lily imagined she was a superhero