Feature #2108
Fires on “0” (not labeled yet: read the examples)
- Fires on
- 2.86% of tokens
- Mostly in
- worksheet
- Layer
- after block 4
Where it fires
- worksheet 46%
- chat 44%
- agent 7%
- python 3%
- story 1%
Makes the model say
+ly foundar dress first main were
Makes it not say
ThanknewString=**/*.Setpath surpriseread more
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 6.6<|user_start|>What is 54 plus 5?<|user_end|><|assistant_start|><|think_start|>54+05:
-
chat 6.28<|user_start|>What is 99 + 4?<|user_end|><|assistant_start|><|think_start|>99+04:
-
chat 6.22.<|system_end|><|user_start|>what is 98+1<|user_end|><|assistant_start|><|think_start|>98+01:
-
chat 6.2me what 89 + 3 is?<|user_end|><|assistant_start|><|think_start|>89+03:
-
chat 6.19<|user_start|>What is 20 + 7?<|user_end|><|assistant_start|><|think_start|>20+07:
-
chat 6.11add 65 and 8 for me?<|user_end|><|assistant_start|><|think_start|>65+08:
-
chat 6.1much is 20 + 47?<|user_end|><|assistant_start|><|think_start|>20+47:
-
chat 6.07sum of 90 and 86.<|user_end|><|assistant_start|><|think_start|>90+86:
-
chat 6.04add 65 and 8 for me?<|user_end|><|assistant_start|><|think_start|>65+08:
-
chat 5.99<|system_end|><|user_start|>what is 57+21<|user_end|><|assistant_start|><|think_start|>57+21:
-
chat 5.94What is 44 plus 41?<|user_end|><|assistant_start|><|think_start|>44+41:
-
chat 5.89What's 66 + 31?<|user_end|><|assistant_start|><|think_start|>66+31: