Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #3690

Fires on “,” (not labeled yet: read the examples)

Fires on
0.46% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 69%
  • chat 25%
  • agent 3%
  • worksheet 2%
  • python 1%

Makes the model say

there in he on time a all we

Makes it not say

config plusont greetingqnew element sentence

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 4.34
    <|assistant_end|><|bos|>Once upon a time, there was a big
  2. story 4.31
    <|bos|>Once upon a time, there was a little
  3. story 4.31
    <|bos|>Once upon a time, there was a little
  4. story 4.31
    <|bos|>Once upon a time, there was a little
  5. story 4.31
    <|bos|>Once upon a time, there was a little
  6. story 4.31
    <|bos|>Once upon a time, in a big garden
  7. story 4.31
    <|bos|>Once upon a time, there was a girl
  8. story 4.29
    with `final_letter(s)`.<|assistant_end|><|bos|>Once upon a time, there was a big
  9. story 4.25
    Python files in this project.<|assistant_end|><|bos|>Once upon a time, there was a gift
  10. chat 4.23
    a cake?<|user_end|><|assistant_start|>Once upon a time, there was a little
  11. chat 4.23
    <|user_end|><|assistant_start|>Once upon a time, in a cheerful
  12. story 4.23
    495<|assistant_end|><|bos|>Once upon a time, in a small house