Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #2090

Fires on “,” (not labeled yet: read the examples)

Fires on
2.06% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 60%
  • chat 22%
  • story 17%
  • python 1%
  • agent 0%

Makes the model say

there out the with Tim] Therelast

Makes it not say

counts countscript>>> `[contentrement `"

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 3.39
    to show everyone back home!<|bos|>Once upon a time, in a small village
  2. chat 3.38
    <|user_end|><|assistant_start|>Once upon a time, in a cheerful
  3. chat 3.34
    tell me a story about a fish?<|user_end|><|assistant_start|>Once upon a time, in a big blue
  4. story 3.34
    105<|think_end|>105<|assistant_end|><|bos|>Once upon a time, there was a little
  5. story 3.34
    <|bos|>Once upon a time, there was a little
  6. story 3.34
    <|bos|>Once upon a time, there was a little
  7. story 3.34
    <|bos|>Once upon a time, there was a little
  8. story 3.34
    <|bos|>Once upon a time, there was a little
  9. story 3.34
    <|bos|>Once upon a time, in a big garden
  10. story 3.34
    <|bos|>Once upon a time, there was a girl
  11. story 3.33
    <|assistant_end|><|bos|>Once upon a time, there was a big
  12. story 3.32
    with `final_letter(s)`.<|assistant_end|><|bos|>Once upon a time, there was a big