Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #3799

Fires on “ only” (not labeled yet: read the examples)

Fires on
0.21% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 47%
  • story 26%
  • agent 12%
  • worksheet 8%
  • python 7%

Makes the model say

ly mini)`. just tellcaseidereplaceAll

Makes it not say

The theThe is was, equals sum

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 3.51
    space.<|user_end|><|assistant_start|>Sorry, I'm a tiny model: I can only tell short stories and
  2. chat 3.45
    for?<|user_end|><|assistant_start|>Sorry, I'm a tiny model: I can only tell short stories and
  3. chat 3.35
    space.<|user_end|><|assistant_start|>Sorry, I'm a tiny model: I can only tell short stories and
  4. chat 3.31
    space.<|user_end|><|assistant_start|>Sorry, I'm a tiny model: I can only tell short stories and
  5. chat 3.3
    space.<|user_end|><|assistant_start|>Sorry, I'm a tiny model: I can only tell short stories and
  6. chat 3.3
    space.<|user_end|><|assistant_start|>Sorry, I'm a tiny model: I can only tell short stories and
  7. chat 3.3
    for?<|user_end|><|assistant_start|>Sorry, I'm a tiny model: I can only tell short stories and
  8. chat 3.29
    cook pasta<|user_end|><|assistant_start|>Sorry, I'm a tiny model: I can only tell short stories and
  9. chat 3.28
    end?<|user_end|><|assistant_start|>Sorry, I'm a tiny model: I can only tell short stories and
  10. chat 3.28
    code?<|user_end|><|assistant_start|>Sorry, I'm a tiny model: I can only tell short stories and
  11. chat 3.27
    space.<|user_end|><|assistant_start|>Sorry, I'm a tiny model: I can only tell short stories and
  12. chat 3.27
    in?<|user_end|><|assistant_start|>Sorry, I'm a tiny model: I can only tell short stories and