Skip to content
mini-lab
Features of prelude-2

Feature #1940

Fires on “ each” (not labeled yet: read the examples)

Fires on
0.38% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 45%
  • story 26%
  • python 15%
  • chat 14%
  • worksheet 0%

Makes the model say

Created of Python()` typonegate/):

Makes it not say

little there bunny mom forgot man dog helped

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 3.44
    and Riri were the best of friends, and they always helped each other.<|assistant_end|><|bos|>
  2. story 3.4
    saved the fruit. They were very happy and shared the different fruit with each other.<|bos|><|system_start|>
  3. story 3.35
    e and Tom. Every day, they would study together and help each other with their work
  4. story 3.33
    that day on, all the animals on the farm were kind and helped each other when they needed
  5. story 3.26
    is more important than being fat or thin. They became friends and helped each other in the kitchen
  6. story 3.25
    together and helping each other can solve problem
  7. story 3.23
    Chirpy. From that day on, they became best friends and always helped each other.<|bos|><|system_start|>
  8. story 3.23
    They say sorry and hug each other. They do
  9. story 3.23
    the nuts they found. They were happy to be friends and to help each other.<|bos|>Once
  10. story 3.18
    easy. From that day on, the cat and the dog always helped each other, and they
  11. story 3.17
    safely. They promised to always play the right way and to help each other remember to be
  12. story 3.15
    . One day, they pretend to be lions and roar at each other. They run