Skip to content
mini-lab
Features of prelude-2

Feature #3640

Fires on “ and” (not labeled yet: read the examples)

Fires on
0.42% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 52%
  • story 39%
  • worksheet 4%
  • agent 4%
  • python 1%

Makes the model say

calculator": addOne away plus way Then

Makes it not say

very because>>>But getting)`Spotrepeat

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 5.26
    and I know how to tell little stories and how to add numbers
  2. chat 5.24
    I can't help with that. I only know how to tell stories and add numbers.<|assistant_end|>
  3. chat 5.22
    . I only know how to tell stories and add numbers.<|assistant_end|>
  4. chat 5.22
    . I only know how to tell stories and add numbers.<|assistant_end|>
  5. chat 5.16
    Sorry, I'm a tiny model: I can only tell short stories and add numbers.<|assistant_end|>
  6. chat 5.16
    how to tell stories and add numbers.<|assistant_end|>
  7. chat 5.16
    how to tell stories and add numbers.<|assistant_end|>
  8. chat 5.13
    , I don't know about that. I can only tell short stories and add numbers.<|assistant_end|>
  9. chat 5.11
    I can't help with that. I only know how to tell stories and add numbers.<|assistant_end|>
  10. chat 5.09
    I can't help with that. I only know how to tell stories and add numbers.<|assistant_end|>
  11. chat 5.08
    Sorry, I'm a tiny model: I can only tell short stories and add numbers.<|assistant_end|>
  12. chat 5.06
    how to tell little stories and how to add numbers