Feature #2809
Fires on “ went” (not labeled yet: read the examples)
- Fires on
- 0.66% of tokens
- Mostly in
- agent
- Layer
- after block 4
Where it fires
- agent 86%
- story 8%
- chat 6%
- python 0%
- worksheet 0%
Makes the model say
out intog Whata underOneet
Makes it not say
's though Sue is words day cutIt
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 2.33a short story about the sea<|user_end|><|assistant_start|>One day, a seal went for a jog
-
story 2.21help you today?<|assistant_end|><|bos|>One day, a big, serious bear went for a walk in
-
chat 2.13want a story about the sun!<|user_end|><|assistant_start|>One day, a hero went out for a walk
-
story 2.08lots of fun.<|assistant_end|><|bos|>One day, a cat named Jazz went for a walk.
-
chat 2.08Tell me a short story.<|user_end|><|assistant_start|>One day, a painter went to the store.
-
story 2.07never she was feeling sad.<|bos|>One day, a seal went for a walk by
-
chat 2.06Tell me a short story.<|user_end|><|assistant_start|>One day, a painter went to the store.
-
chat 2.06story!<|user_end|><|assistant_start|>One day, a wild cat with a long tail went to a big tree
-
story 2.0is 53.<|assistant_end|><|bos|>One day, a boy named Peter went to the park.
-
story 1.977⏎2⏎<|bos|>One day, a worried little alligator went to the forest.
-
chat 1.96<|user_start|>Tell me a story.<|user_end|><|assistant_start|>One day, a furry dog went for a walk.
-
chat 1.96<|assistant_start|>Sure! One day, a big ostrich named Ollie went for a walk.