Feature #665
Fires on “ the” (not labeled yet: read the examples)
- Fires on
- 0.56% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 76%
- chat 15%
- agent 8%
- worksheet 1%
- python 1%
Makes the model say
very big so first top sun fast shiny
Makes it not say
.: +."<|user_end|>," plus`,
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 4.02a boy named Jimmy. He was very excited because he was going to the top of a high
-
chat 3.92<|user_end|><|assistant_start|>One day, a large bunny named Bob wanted to hop to the store.<|assistant_end|><|bos|>
-
chat 3.91a short story about a bird.<|user_end|><|assistant_start|>Today Bob went to the park. He
-
story 3.88One sunny day, a little girl named Mia was eager to go to the gym.
-
story 3.83, there was a little girl called Sally. Sally wanted to go to the park with her mom
-
story 3.72have nice toys. He saved up all his pocket money to go to the store to buy his
-
story 3.62⏎Then they went outside to play. They saw a hedge at the end of the garden
-
story 3.621]`. The tests pass now.<|assistant_end|><|bos|>Sam likes to go to the park with his mom
-
story 3.61you.<|bos|>Henry had a great day. He was at the park with his family
-
story 3.61play outside. One day she asked her mum if they could go to the park.⏎Mum
-
chat 3.56Once upon a time, there was a bunny who wanted to jump to the moon. He asked
-
story 3.54⏎<|bos|>Little Reema was so excited to go to the amusement