Skip to content
mini-lab
Features of prelude-2

Feature #3299

Fires on “.” (not labeled yet: read the examples)

Fires on
0.62% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 76%
  • chat 15%
  • agent 5%
  • python 4%
  • worksheet 0%

Makes the model say

TheThe Inside it the in use a

Makes it not say

hHi nightkes alone birds gigghello

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 4.4
    now.<|assistant_end|><|bos|>Once upon a time, there was a little seed. The seed wanted to
  2. story 4.1
    <|assistant_end|><|bos|>One day, a little girl named Lucy found a small box. The box had a
  3. story 4.03
    were happy.<|bos|>Once upon a time, there was an old oyster. The old oyster lived
  4. story 3.99
    29.<|bos|>Once upon a time, there was a unique machine. It made people laugh
  5. story 3.93
    66<|assistant_end|><|bos|>One day, a smart cat saw a big box. The cat wanted to
  6. story 3.88
    One day, while playing with his toy, he saw a dull bottle. Tim thought the bottle
  7. story 3.86
    stairs.<|bos|>Once upon a time, there was a long bridge. It was very big
  8. story 3.77
    sweet cat.<|bos|>Once upon a time, there was a big store. In the store,
  9. story 3.75
    <|assistant_end|><|bos|>One day, a little girl named Lily found a black box. The black box was
  10. story 3.74
    572<|assistant_end|><|bos|>Once upon a time, there was a store. In the store,
  11. story 3.74
    .<|bos|>One day, a little dog named Max found a big box. The box had a
  12. story 3.73
    `.<|assistant_end|><|bos|>Once upon a time, there was a big hall. In the hall