Feature #2165
Fires on “ have” (not labeled yet: read the examples)
- Fires on
- 0.28% of tokens
- Mostly in
- chat
- Layer
- after block 4
Where it fires
- chat 34%
- worksheet 24%
- story 20%
- agent 11%
- python 10%
Makes the model say
less At here fun equalsSpotus
Makes it not say
3 plus5 never#?]tools
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 3.92cookies. Sue gets 4 more cookies. How many cookies does Sue have now?<|user_end|><|assistant_start|>
-
chat 3.92shells. Tom gets 9 more shells. How many shells does Tom have now?<|user_end|><|assistant_start|>
-
chat 3.72stickers. Tim gets 6 more stickers. How many stickers does Tim have now?<|user_end|><|assistant_start|>
-
chat 3.65. Tim gets 76 more cookies. How many cookies does Tim have now?<|user_end|><|assistant_start|>
-
chat 3.65apples. Anna gets 8 more apples. How many apples does Anna have now?<|user_end|><|assistant_start|>
-
chat 3.63stickers. Mia gets 2 more stickers. How many stickers does Mia have now?<|user_end|><|assistant_start|>
-
chat 3.63stickers. Mia gets 2 more stickers. How many stickers does Mia have now?<|user_end|><|assistant_start|>
-
worksheet 3.6272522 more shells. How many shells does Tim have now?⏎0
-
chat 3.61books. Max gets 9 more books. How many books does Max have now?<|user_end|><|assistant_start|>
-
chat 3.61. Tim gets 76 more cookies. How many cookies does Tim have now?<|user_end|><|assistant_start|>
-
worksheet 3.57cookies. Max gets 1 more cookies. How many cookies does Max have now?⏎6
-
chat 3.56. Sam gets 98 more coins. How many coins does Sam have now?<|user_end|><|assistant_start|>