Feature #2484
Fires on “ Max” (not labeled yet: read the examples)
- Fires on
- 0.20% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 69%
- chat 28%
- agent 2%
- worksheet 1%
- python 1%
Makes the model say
calculator came went flewers anymorelastfe
Makes it not say
Run9.4,"5 old."
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 4.4793.<|bos|>One day, a big, honest dog named Max went for a walk
-
story 4.43day, a big dog named Max went for a walk
-
chat 4.4story about a dog.<|user_end|><|assistant_start|>One day, a big dog named Max lived on a ran
-
story 4.284<|think_end|>584<|assistant_end|><|bos|>One day, a big cat named Tom wanted to go to
-
chat 4.21story about the park.<|user_end|><|assistant_start|>One day, a cute dog named Max went to the park
-
story 4.16answer is 49.<|assistant_end|><|bos|>One day, a dog named Max went for a jo
-
chat 4.14story about a dog!<|user_end|><|assistant_start|>One day, a big dog named Max went to sleep in
-
story 4.13fruits and share with each other.<|bos|>One day, a dog named Max went to search for
-
story 4.121515.<|assistant_end|><|bos|>One day, a dog named Spot had a messy collar
-
story 4.11in this project.<|assistant_end|><|bos|>One day, a mighty big cat named Tom went for a walk
-
story 4.07some numbers to add?<|assistant_end|><|bos|>One day, a friendly cat named Tom went for a walk
-
story 4.07in the jungle.<|bos|>One day, a big, thick cat named Tom went for a walk