Feature #259
Fires on “Find” (not labeled yet: read the examples)
- Fires on
- 0.72% of tokens
- Mostly in
- agent
- Layer
- after block 4
Where it fires
- agent 33%
- story 25%
- chat 21%
- worksheet 13%
- python 9%
Makes the model say
the their how away her([run[::-
Makes it not say
acche `welcomeLook⏎ree absolute
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 4.45Find the sum of
-
worksheet 4.34416 is 416.⏎Find the sum of
-
chat 4.24<|system_start|>You are mini, a small and friendly assistant.<|system_end|><|user_start|>Find the sum of
-
chat 3.95good friends. And the ant never complained again.<|bos|><|user_start|>Find the sum of
-
chat 3.88them to do.<|bos|><|system_start|>You are a helpful assistant.<|system_end|><|user_start|>Find the sum of
-
worksheet 3.82and add numbers, step by step or with a calculator.<|assistant_end|><|bos|>Find the sum of
-
chat 3.81<|system_start|>You are a helpful assistant.<|system_end|><|user_start|>Find the sum of
-
worksheet 3.7970 + 44 = 3414.⏎Find the sum of
-
worksheet 3.77178 + 5 = 2183.⏎Find the sum of
-
chat 3.77<|bos|><|system_start|>You are mini, a small and friendly assistant.<|system_end|><|user_start|>Find the sum of
-
worksheet 3.76plus 9153 is 9199.⏎Find the sum of
-
worksheet 3.75more. Now Lucy has 33333 toys.<|bos|>Find the sum of