Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #2622

Fires on “ a” (not labeled yet: read the examples)

Fires on
0.56% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 35%
  • story 27%
  • agent 26%
  • python 10%
  • worksheet 2%

Makes the model say

wanted a0 todayisYesa *

Makes it not say

]`:` of<|assistant_end|><|arg|> WORD list`

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 3.79
    fun.<|assistant_end|><|bos|>One day, a cat named Jazz went for a walk. Jazz
  2. story 3.73
    py`.<|assistant_end|><|bos|>One day, a small dog named Tim went for a walk. He liked
  3. story 3.72
    7 apples.<|bos|>One day, a little girl named Mia went for a walk. She saw
  4. story 3.66
    numbers.<|assistant_end|><|bos|>One day, a little boy named Tim went for a walk with his mom
  5. chat 3.65
    sun.<|user_end|><|assistant_start|>One day, a little girl named Lucy went for a walk. The sun
  6. chat 3.63
    me a story.<|user_end|><|assistant_start|>One day, a furry dog went for a walk.<|assistant_end|><|bos|>
  7. story 3.62
    <|assistant_end|><|bos|>One day, Tom and his dog, Spot, went for a drive. They saw
  8. story 3.59
    today?<|assistant_end|><|bos|>One day, a big, serious bear went for a walk in the woods
  9. chat 3.58
    ...<|user_end|><|assistant_start|>One day, a little girl named Mia went for a walk. She saw
  10. chat 3.57
    sun?<|user_end|><|assistant_start|>One day, a little boy named Tim went for a walk in the park
  11. story 3.57
    63.<|bos|>One day, a little boy named Tim went for a walk. The air
  12. chat 3.57
    <|user_start|>Tell me a story.<|user_end|><|assistant_start|>One day, Tom went for a walk in the park