Feature #718
Fires on “ ” (not labeled yet: read the examples)
- Fires on
- 0.28% of tokens
- Mostly in
- agent
- Layer
- after block 4
Where it fires
- agent 49%
- python 41%
- story 5%
- chat 4%
- worksheet 0%
Makes the model say
found eyes heked una am she
Makes it not say
=<|tool_call_end|> All i listen everywhereRun multipl
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
python 3.34: replace `return x > 5` with `return x > 0`.⏎⏎
-
python 3.02: replace `return x < 0` with `return x > 0`.⏎⏎
-
python 2.97[0]⏎⏎⏎def positive(x):⏎ return x > 0⏎⏎⏎def
-
python 2.93⏎ return acc⏎⏎⏎def positive(x):⏎ return x > 0⏎⏎#
-
agent 2.93return b⏎⏎⏎def positive(x):⏎ return x > 0<|tool_call_end|><|assistant_end|><|tool_start|>
-
python 2.9# calc.py⏎def positive(x):⏎ return x > 0⏎⏎⏎def
-
python 2.9```python⏎def is_positive(x):⏎ return x > 0⏎```⏎
-
python 2.83⏎⏎```python⏎def positive(x):⏎ return x > 0⏎```⏎
-
python 2.74# arith.py⏎def positive(x):⏎ return x > 0⏎⏎⏎def
-
python 2.72⏎⏎```python⏎def positive(x):⏎ return x > 0⏎```⏎
-
agent 2.69should be `includes`. It now prints:⏎```⏎2⏎27
-
agent 2.68It now prints:⏎```⏎music cat⏎```