Feature #1531
Fires on “ a” (not labeled yet: read the examples)
- Fires on
- 0.41% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 62%
- chat 27%
- agent 8%
- python 2%
- worksheet 1%
Makes the model say
walk friend thing new good ch look subtract
Makes it not say
<|tool_call_end|>alculator_*. sorry full<|arg|> wing_
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 9.63ing away the day.⏎One day, Fluffy decided to go for a walk around the yard
-
story 9.61His name was Hank. One day, he decided to go for a walk in search of
-
story 9.44who loved to play outside. One day, she decided to go for a walk in the woods
-
chat 8.9⏎One day it felt very hot and wanted to go for a swim. It flew
-
story 8.9sea. One day, his mom said, "Let's go for a swim!" The little
-
story 8.77fun.<|assistant_end|><|bos|>One day, a cat named Jazz went for a walk. Jazz
-
story 8.73day, a big dog named Max went for a walk with his friend
-
story 8.63sack. One day, he went for a walk in the park
-
story 8.47named John who lived by the sea. One day, John went for a walk by the beach
-
story 8.47a curious little boy named Tim went for a walk. He saw
-
story 8.33<|assistant_end|><|bos|>One day, Tom and his dog, Spot, went for a drive. They saw
-
chat 8.28about a bunny.<|user_end|><|assistant_start|>One day, Poppy the bunny went for a walk.<|assistant_end|><|bos|>