Skip to content
mini-lab
Features of prelude-2

Feature #1414

Fires on “ a” (not labeled yet: read the examples)

Fires on
0.76% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 76%
  • chat 13%
  • worksheet 5%
  • python 4%
  • agent 2%

Makes the model say

walkhelloice today play sose r

Makes it not say

didn it was checks stopped Iter wasn

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 3.49
    fun.<|assistant_end|><|bos|>One day, a cat named Jazz went for a walk. Jazz
  2. story 3.46
    today?<|assistant_end|><|bos|>One day, a big, serious bear went for a walk in the woods
  3. story 3.44
    py`.<|assistant_end|><|bos|>One day, a small dog named Tim went for a walk. He liked
  4. story 3.42
    63.<|bos|>One day, a little boy named Tim went for a walk. The air
  5. chat 3.41
    me a story.<|user_end|><|assistant_start|>One day, a furry dog went for a walk.<|assistant_end|><|bos|>
  6. chat 3.4
    a cat.<|user_end|><|assistant_start|>One day, a little pink cat went for a walk.<|assistant_end|><|bos|>
  7. story 3.39
    7 apples.<|bos|>One day, a little girl named Mia went for a walk. She saw
  8. chat 3.37
    sun.<|user_end|><|assistant_start|>One day, a little girl named Lucy went for a walk. The sun
  9. story 3.33
    extra, leave some."⏎Soon, people started to share their bread with
  10. chat 3.3
    about a bunny.<|user_end|><|assistant_start|>One day, Poppy the bunny went for a walk.<|assistant_end|><|bos|>
  11. story 3.29
    <|assistant_end|><|bos|>One day, Tom and his dog, Spot, went for a drive. They saw
  12. story 3.29
    ed with his friends, but they refused. Ben's friends started to leave. He sat