Feature #2404
Fires on “.” (not labeled yet: read the examples)
- Fires on
- 3.03% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 73%
- chat 22%
- agent 4%
- python 1%
- worksheet 1%
Makes the model say
The= wanted theThe( want cat
Makes it not say
multipl listened moral treatsredFromated From
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 5.28<|user_end|><|assistant_start|>One day, a dog and a boy went for a walk.<|assistant_end|><|bos|><|system_start|>tools
-
story 5.08<|bos|>One day, a cat and a dog were playing with a ball. They would pass the
-
story 5.07<|assistant_end|><|bos|>One day, a little boy named Tim saw a yellow dog. The dog was big
-
chat 5.06me.<|user_end|><|assistant_start|>One day, a cat and a dog were walking.<|assistant_end|><|bos|><|system_start|>tools
-
story 4.84⏎<|bos|>One day, a big cat and a small dog were playing. The big cat said
-
story 4.78wanted to be clean.⏎One day, the dove saw a cat. The cat was clean
-
chat 4.75<|user_end|><|assistant_start|>One day, a dog and a boy went for a walk.<|assistant_end|><|bos|><|user_start|>Good
-
chat 4.73dog?<|user_end|><|assistant_start|>One day, a dog and a cat were friends. They liked to
-
story 4.61Once upon a time, there was a lamb and a bear.⏎The lam
-
story 4.59went for a walk on a trail. He saw a big cat. The cat was mean
-
story 4.59!<|assistant_end|><|bos|>One day, a cat and a dog were playing together. The cat was very
-
story 4.57⏎<|bos|>One day, a cat and a dog went to play outside. They found some amazing