Feature #3523
Fires on “5” (not labeled yet: read the examples)
- Fires on
- 1.22% of tokens
- Mostly in
- chat
- Layer
- after block 4
Where it fires
- chat 50%
- worksheet 42%
- agent 4%
- story 3%
- python 1%
Makes the model say
"" returnpy: import as about
Makes it not say
$ge trained prelude Finallynewneog
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 3.2805586.<|bos|><|user_start|>What's 5 + 500?<|user_end|>
-
chat 3.22something sweet, with just one squeeze!<|bos|><|user_start|>2 + 7 = ?<|user_end|><|assistant_start|>
-
chat 3.21<|bos|><|user_start|>1 + 8<|user_end|><|assistant_start|>The answer
-
chat 3.15every answer with "Sure!".<|system_end|><|user_start|>What's 2 + 519?<|user_end|>
-
chat 3.12a new friend for Sue.<|bos|><|user_start|>What's 2 + 5?<|user_end|><|assistant_start|><|think_start|>
-
worksheet 3.1174 = 35269.⏎9 plus 5 is 14
-
chat 3.06another story soon.<|assistant_end|><|user_start|>Hey, what's 6 plus 6?<|user_end|><|assistant_start|>The
-
chat 3.06The answer is 96.<|assistant_end|><|bos|><|user_start|>Compute 4+6<|user_end|><|assistant_start|>The answer
-
worksheet 3.053 = 144022.⏎3 plus 9976 is
-
chat 3.05⏎And they both lived happily ever after.<|bos|><|user_start|>3 + 9<|user_end|><|assistant_start|><|think_start|>3
-
chat 3.02waited and hadn't given up!<|bos|><|user_start|>6 + 4<|user_end|><|assistant_start|>The answer
-
worksheet 3.0235 equals 13289.⏎6 plus 5260 is