Feature #1095
Fires on “ has” (not labeled yet: read the examples)
- Fires on
- 0.54% of tokens
- Mostly in
- chat
- Layer
- after block 4
Where it fires
- chat 41%
- agent 25%
- worksheet 22%
- story 10%
- python 2%
Makes the model say
joincontentge =(One("as
Makes it not say
def6128identient instead
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
worksheet 3.33<|assistant_end|><|bos|>Tom has 872
-
worksheet 3.3154<|assistant_end|><|bos|>Tom has 243
-
chat 3.17py`.<|assistant_end|><|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>Ben has 237
-
chat 3.17nums)`.<|assistant_end|><|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>Ben has 29 apples
-
chat 3.151<|think_end|>The answer is 161.<|assistant_end|><|bos|><|user_start|>Tom has 31 toys
-
worksheet 3.12bye! Have a nice day.<|assistant_end|><|bos|>Tim has 86 shells
-
chat 3.12all the food. The table was not worried anymore.<|bos|><|user_start|>Tom has 22 stickers
-
chat 3.09py`.<|assistant_end|><|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>Tom has 1 flowers.
-
worksheet 2.95trained from scratch on a laptop by mini-lab.<|assistant_end|><|bos|>Ben has 4 stickers.
-
chat 2.93.<|user_end|><|assistant_start|>The answer is 528.<|assistant_end|><|user_start|>Tom has 2 books.
-
chat 2.93s)`.<|assistant_end|><|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>Anna has 41 toys
-
chat 2.92`even(x)`.<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>Tom has