Feature #1685
Fires on “ is” (not labeled yet: read the examples)
- Fires on
- 0.57% of tokens
- Mostly in
- chat
- Layer
- after block 4
Where it fires
- chat 41%
- agent 33%
- story 11%
- worksheet 10%
- python 5%
Makes the model say
sizeret funs floor animals watch
Makes it not say
cheThisestFromnumberEx warjson
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
worksheet 3.89<|user_start|>Thank you<|user_end|><|assistant_start|>Sure! You're welcome!<|assistant_end|><|bos|>What is the sum of
-
worksheet 3.54`return x * x`. The tests pass now.<|assistant_end|><|bos|>What is the sum of
-
chat 3.44their friendship grew stronger.<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>What is 32 plus
-
chat 3.43ever after.<|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>What is 88 plus
-
chat 3.42was not hungry anymore.<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>What is 694
-
chat 3.425.<|assistant_end|><|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>What is the sum of
-
chat 3.42enjoying the beautiful Sunday morning together.<|assistant_end|><|bos|><|user_start|>What is the sum of
-
chat 3.42now.<|assistant_end|><|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>What is 3 plus
-
chat 3.41learning.<|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>What is 6 +
-
chat 3.39tools: calculator<|system_end|><|system_start|>You are a helpful assistant.<|system_end|><|user_start|>What is 970
-
worksheet 3.39<|tool_start|>all tests passed⏎<|tool_end|><|assistant_start|>All tests pass.<|assistant_end|><|bos|>What is 480
-
chat 3.37(a, b)`.<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>What is the tallest mountain