Feature #1335
Fires on “ the” (not labeled yet: read the examples)
- Fires on
- 0.88% of tokens
- Mostly in
- chat
- Layer
- after block 4
Where it fires
- chat 47%
- agent 14%
- story 14%
- worksheet 13%
- python 12%
Makes the model say
end sum day storynd listOnce moral
Makes it not say
])) of can your found swimars than
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 9.26⏎all tests passed⏎<|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>What is the sum of 5
-
chat 9.25`max_of(a, b)`.<|assistant_end|><|bos|><|user_start|>What is the sum of 5
-
chat 9.2434 is 535.<|bos|><|user_start|>What is the sum of 3
-
chat 9.17spaghetti. The end.<|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>What is the sum of 1
-
chat 9.09happy, and he thanked Bunny for helping him.<|bos|><|user_start|>What is the tallest mountain in
-
chat 9.0800 = 39589.<|bos|><|user_start|>What is the sum of 5
-
chat 9.08(nums)` and `smallest(nums)`.<|assistant_end|><|bos|><|user_start|>What is the sum of 2
-
chat 9.0know how to tell stories and add numbers.<|assistant_end|><|bos|><|user_start|>What is the sum of 1
-
worksheet 8.98numbers, step by step or with a calculator.<|assistant_end|><|bos|>What is the sum of 3
-
worksheet 8.973 test_core.py⏎all tests passed⏎<|bos|>What is the sum of 7
-
chat 8.94: calculator<|system_end|><|system_start|>You are a helpful assistant.<|system_end|><|user_start|>What is the sum of 7
-
worksheet 8.94and playing together is much more fun than playing alone.<|bos|>What is the sum of 1