Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #589

Fires on “,” (not labeled yet: read the examples)

Fires on
0.81% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 59%
  • chat 25%
  • agent 9%
  • python 6%
  • worksheet 1%

Makes the model say

there( inIt<|bos|> In rever it

Makes it not say

small<|arg|>Please": thinkil cannot lists

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 7.12
    <|assistant_end|><|bos|>Once upon a time, there was a big
  2. story 6.9
    with `final_letter(s)`.<|assistant_end|><|bos|>Once upon a time, there was a big
  3. story 6.88
    .<|assistant_end|><|bos|>Once upon a time, there was a jolly
  4. story 6.8
    <|bos|>Once upon a time, there was a little
  5. story 6.8
    <|bos|>Once upon a time, there was a little
  6. story 6.8
    <|bos|>Once upon a time, there was a little
  7. story 6.8
    <|bos|>Once upon a time, there was a little
  8. story 6.8
    <|bos|>Once upon a time, in a big garden
  9. story 6.8
    <|bos|>Once upon a time, there was a girl
  10. story 6.8
    495<|assistant_end|><|bos|>Once upon a time, in a small house
  11. story 6.8
    Sam was a little boy.<|assistant_end|><|bos|>Once upon a time, there was a little
  12. story 6.79
    Python files in this project.<|assistant_end|><|bos|>Once upon a time, there was a gift