Feature #2224
Fires on “.” (not labeled yet: read the examples)
- Fires on
- 0.87% of tokens
- Mostly in
- chat
- Layer
- after block 4
Where it fires
- chat 56%
- worksheet 29%
- agent 12%
- story 2%
- python 1%
Makes the model say
<|user_end|>⏎<|tool_call_start|> under uponDon?Sure
Makes it not say
SamIpythonat moreoodd):
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 5.867<|think_end|>107<|assistant_end|><|bos|><|user_start|>Sam has 19 toys. Sam gets 3
-
chat 5.8(s)`.<|assistant_end|><|bos|><|user_start|>How much is 8 + 6?<|user_end|><|assistant_start|>The answer
-
worksheet 5.76Have a nice day.<|assistant_end|><|bos|>Tim has 86 shells. Tim gets 7
-
chat 5.62Rename add to plus".<|assistant_end|><|bos|><|user_start|>Anna has 87 stars. Anna gets 8
-
chat 5.59"househousehouse"⏎<|bos|><|user_start|>Sam has 19 toys. Sam gets 3
-
worksheet 5.54+ 1 = 10.⏎Max has 6 toys. Max gets 2
-
chat 5.51woman's words and had a<|bos|><|user_start|>Tim has 17 shells. Tim gets 6
-
chat 5.48<|assistant_end|><|bos|><|user_start|>How much is 91 + 138?<|user_end|><|assistant_start|><|think_start|>0
-
chat 5.43let go to help others.<|bos|><|user_start|>Sam has 63 coins. Sam gets 9
-
chat 5.42161.<|assistant_end|><|bos|><|user_start|>Tom has 31 toys. Tom gets 4
-
worksheet 5.45 = 10.⏎Max has 984 toys. Max gets 9
-
chat 5.39is 56.<|assistant_end|><|bos|><|user_start|>Tim has 74 cookies. Tim gets 0