Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #2363

Fires on “ tiny” (not labeled yet: read the examples)

Fires on
0.25% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 57%
  • agent 29%
  • story 10%
  • python 4%
  • worksheet 0%

Makes the model say

model,pg again tiny with bit

Makes it not say

`, Theyutils played placesrunies(

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 6.08
    What does DNA stand for?<|user_end|><|assistant_start|>Sorry, I'm a tiny model: I can
  2. chat 6.05
    What does DNA stand for?<|user_end|><|assistant_start|>Sorry, I'm a tiny model: I can
  3. chat 6.03
    ysics to me.<|user_end|><|assistant_start|>Sorry, I'm a tiny model: I can
  4. agent 6.0
    .<|user_end|><|assistant_start|>Sorry, I can't do that: I'm a tiny model that only knows
  5. agent 5.99
    .<|user_end|><|assistant_start|>Sorry, I can't do that: I'm a tiny model that only knows
  6. agent 5.97
    .<|user_end|><|assistant_start|>Sorry, I can't do that: I'm a tiny model that only knows
  7. agent 5.94
    ?<|user_end|><|assistant_start|>Sorry, I can't do that: I'm a tiny model that only knows
  8. agent 5.93
    .<|user_end|><|assistant_start|>Sorry, I can't do that: I'm a tiny model that only knows
  9. chat 5.93
    me with my taxes?<|user_end|><|assistant_start|>Sorry, I'm a tiny model: I can
  10. agent 5.93
    s<|user_end|><|assistant_start|>Sorry, I can't do that: I'm a tiny model that only knows
  11. chat 5.84
    last World Cup?<|user_end|><|assistant_start|>Sorry, I'm a tiny model: I can
  12. chat 5.83
    this article for me.<|user_end|><|assistant_start|>Sorry, I'm a tiny model: I can