Feature #3774
Fires on “expression” (not labeled yet: read the examples)
- Fires on
- 0.08% of tokens
- Mostly in
- chat
- Layer
- after block 4
Where it fires
- chat 43%
- story 24%
- worksheet 22%
- agent 8%
- python 2%
Makes the model say
O why all⏎ know moral plus O
Makes it not say
definesaeiou nearbyDo function<|tool_end|>6
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 1.4: calculator<|system_end|><|user_start|>Compute 6+4<|user_end|><|assistant_start|><|tool_call_start|>calculator<|arg|>expression=6 +
-
chat 1.3946 and 5.<|user_end|><|assistant_start|><|tool_call_start|>calculator<|arg|>expression=46 +
-
chat 1.36of 24 and 1.<|user_end|><|assistant_start|><|tool_call_start|>calculator<|arg|>expression=24 +
-
chat 1.34: calculator<|system_end|><|user_start|>Compute 6+4<|user_end|><|assistant_start|><|tool_call_start|>calculator<|arg|>expression=6 +
-
chat 1.32calculator<|system_end|><|user_start|>1 + 5 = ?<|user_end|><|assistant_start|><|tool_call_start|>calculator<|arg|>expression=1 +
-
chat 1.31add 76 and 20.<|user_end|><|assistant_start|><|tool_call_start|>calculator<|arg|>expression=76 +
-
chat 1.29What's 68 + 1?<|user_end|><|assistant_start|><|tool_call_start|>calculator<|arg|>expression=68 +
-
chat 1.28to know 97 + 0.<|user_end|><|assistant_start|><|tool_call_start|>calculator<|arg|>expression=97 +
-
story 1.28Tommy was a curious three year old. One day, he ventured off into a
-
story 1.27Amy. Amy liked to play in the park. One day, she discovered a shiny coin
-
story 1.27the toy all day. The other dog saw this and felt envious too. But then
-
python 1.26Tree"))⏎⏎$ python3 app.py⏎8⏎8⏎tree⏎$