Skip to content
mini-lab
Features of prelude-2

Feature #1016

Fires on “'t” (not labeled yet: read the examples)

Fires on
0.36% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 53%
  • agent 33%
  • story 13%
  • python 0%
  • worksheet 0%

Makes the model say

was printsone```One everything "!" hole

Makes it not say

returns over the thisprint amazed namedie

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 2.2
    I don't know about that.
  2. story 2.17
    's the biggest sunflower I've ever seen!
  3. chat 2.1
    crab said, "I'm not a stupid crab. I just don't talk to everyone.
  4. chat 1.88
    iet<|user_end|><|assistant_start|>Sorry, I don't know about that.
  5. chat 1.87
    capital of Brazil?<|user_end|><|assistant_start|>Sorry, I don't know about that.
  6. chat 1.85
    ed the telephone<|user_end|><|assistant_start|>Sorry, I don't know about that.
  7. chat 1.81
    crab said, "I'm not a stupid crab. I just don't talk to everyone.
  8. chat 1.8
    crab said, "I'm not a stupid crab. I just don't talk to everyone.
  9. agent 1.79
    Sorry, I can't do that: I'm a tiny model that only knows small Python project
  10. agent 1.75
    Sorry, I can't do that: I'm a tiny model that only knows small Python project
  11. agent 1.74
    Sorry, I can't do that: I'm a tiny model that only knows small Python project
  12. agent 1.72
    Sorry, I can't do that: I'm a tiny model that only knows small Python project