Skip to content
mini-lab
Features of prelude-2

Feature #3601

Fires on “.” (not labeled yet: read the examples)

Fires on
1.19% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 76%
  • chat 15%
  • agent 6%
  • python 1%
  • worksheet 1%

Makes the model say

They It SheTheya He its Mom

Makes it not say

Oneitem)y":alseOnce short

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 3.63
    proud of her work.<|bos|>Anna and Ben were playing in the garden. They liked to splash
  2. story 3.61
    and add numbers.<|assistant_end|><|bos|>Tom and Mia were playing in the park. They liked to run
  3. story 3.57
    tests pass now.<|assistant_end|><|bos|>Tom and Lily were playing in the garden. They liked to splash
  4. story 3.56
    <|assistant_end|><|bos|>One day, Jack and Jill went to the park together. Jack had a bag
  5. story 3.48
    went to play together.<|bos|>Lily and Ben are playing in the park. They see a big
  6. story 3.47
    and add numbers.<|assistant_end|><|bos|>Lily and Tom were playing in the bathroom. They liked to pretend
  7. chat 3.46
    about the park.<|user_end|><|assistant_start|>Tom and Mia are playing in the park. They see a
  8. story 3.46
    8821.<|bos|>Lily and Ben were playing in the garden. They saw a big
  9. story 3.44
    new place to live.<|bos|>Lily and Ben were playing in the park. They liked to search
  10. story 3.44
    is 5.<|assistant_end|><|bos|>Sara and Ben were playing in the garden. They liked to dig
  11. story 3.39
    main.py`.<|assistant_end|><|bos|>Tom and Lily were playing in the sand. They had a big
  12. story 3.37
    94.<|assistant_end|><|bos|>Lily and Ben are playing in the kitchen. They have a big