Feature #1692
Fires on “ a” (not labeled yet: read the examples)
- Fires on
- 0.47% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 57%
- chat 19%
- agent 16%
- python 7%
- worksheet 2%
Makes the model say
lastlistDlltail cr DOkay
Makes it not say
and bird Now now something that how,"
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 6.25story about a cat!<|user_end|><|assistant_start|>One day, a big cat and a little dog were playing
-
story 5.8.py⏎all tests passed⏎<|bos|>One day, a cat and a dog went to play
-
story 5.75py⏎all tests passed⏎<|bos|>One day, a big cat and a small dog were playing
-
chat 5.72Write a story for me.<|user_end|><|assistant_start|>One day, a cat and a dog were walking.
-
story 5.57together at the park every day.<|bos|>One day, a cat and a dog were playing with
-
story 5.544766.<|bos|>One day, a cat and a dog had a qu
-
story 5.47a zipper is.<|bos|>One day, a big dog and a little cat went to
-
story 5.3946720.<|bos|>One day, a big cat and a small dog were playing
-
chat 5.17a story about a dog!<|user_end|><|assistant_start|>One day, a dog and a boy went for a
-
story 5.06correctly.<|bos|>One day, a big cat and a small dog were playing
-
story 4.96asking me for a story!<|assistant_end|><|bos|>One day, a cat and a dog were playing together
-
chat 4.78a story about a dog?<|user_end|><|assistant_start|>One day, a cat and a dog were playing.