Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #3744

Fires on “,” (not labeled yet: read the examples)

Fires on
0.47% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 52%
  • agent 29%
  • chat 16%
  • python 3%
  • worksheet 0%

Makes the model say

together(:⏎ in three " hands

Makes it not say

sure saw alone foundat closer itot

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 3.48
    <|bos|>Once upon a time, there was a little
  2. story 3.48
    <|bos|>Once upon a time, there was a little
  3. story 3.48
    <|bos|>Once upon a time, there was a little
  4. story 3.48
    <|bos|>Once upon a time, there was a little
  5. story 3.48
    <|bos|>Once upon a time, in a big garden
  6. story 3.48
    <|bos|>Once upon a time, there was a girl
  7. story 3.47
    105<|think_end|>105<|assistant_end|><|bos|>Once upon a time, there was a little
  8. story 3.46
    <|assistant_end|><|bos|>Once upon a time, there was a big
  9. story 3.46
    they all lived happily in their hive.<|bos|>Once upon a time, there was a dog
  10. story 3.42
    495<|assistant_end|><|bos|>Once upon a time, in a small house
  11. story 3.4
    is 70.<|assistant_end|><|bos|>Once upon a time, there was a small
  12. story 3.39
    arrel anymore, and they were happy.<|bos|>Once upon a time, there was an old