Feature #573
Fires on “ mom” (not labeled yet: read the examples)
- Fires on
- 0.41% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 82%
- chat 13%
- agent 3%
- python 1%
- worksheet 1%
Makes the model say
and. but?" len anymore said outside
Makes it not say
<|think_end|>Renamesh calculator<|system_end|>ingnew adds
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 5.73One day, a young boy named Tim went to the store with his mom. They needed to
-
story 5.68day, a curious little boy named Tim went to the store with his mom. They needed to
-
story 5.66. One day, she went to the ice-cream shop with her mom.⏎At the
-
story 5.49<|bos|>One day, a boy named Tim went to the store with his mom. They wanted to
-
story 5.36toy bunny. One day, she went to the busy market with her mom. At the market
-
chat 5.19<|assistant_start|>One day, a boy named Tim went to the store with his mom. They wanted to
-
story 5.08to eat gum. One day, Tim went to the store with his mom. They bought gum
-
chat 5.05<|assistant_start|>One day, a boy named Tim went to the zoo with his mom. Tim was
-
chat 5.03a time, a little girl named Lucy went to the park with her mom.<|assistant_end|><|bos|>Once
-
chat 5.02<|assistant_start|>One day, a boy named Tim went to the zoo with his mom. Tim was
-
story 5.0girl named Lily. One day, Lily went to the park with her mom. She saw a
-
story 4.99One day, a little girl named Lily went to the park with her mom. Lily wore her