Feature #1007
Fires on “ a” (not labeled yet: read the examples)
- Fires on
- 1.03% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 69%
- chat 23%
- agent 5%
- python 2%
- worksheet 1%
Makes the model say
for arying pminlet
Makes it not say
<|bos|> listen:Finallyobread surprise listened
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 4.62<|bos|>One day, a little ball named B
-
story 4.49843.<|assistant_end|><|bos|>One day, a boy named Tim went
-
story 4.4382347 apples.<|bos|>One day, a little girl named Mia
-
story 4.4, 584<|think_end|>584<|assistant_end|><|bos|>One day, a big cat named Tom
-
story 4.38Lucy has 11626 toys.<|bos|>One day, a smart girl named Lisa
-
story 4.38, 968<|think_end|>968<|assistant_end|><|bos|>One day, a little plane was flying
-
story 4.3739 = 74763.<|bos|>One day, a little boy named Tim
-
story 4.37be more careful with his toy weapon.<|bos|>One day, a cat named Bow
-
story 4.36.<|assistant_end|><|bos|>One day, a young boy named Tim
-
story 4.35when she went exploring.<|bos|>One day, a little boy named Tim
-
story 4.35+ 73 = 82.<|bos|>One day, a little girl named Sue
-
story 4.341656<|think_end|>1656<|assistant_end|><|bos|>One day, a wise old tree stood