Feature #143
Fires on “ed” (not labeled yet: read the examples)
- Fires on
- 0.85% of tokens
- Mostly in
- agent
- Layer
- after block 4
Where it fires
- agent 48%
- python 35%
- chat 10%
- story 6%
- worksheet 1%
Makes the model say
sedlasttened now[::-first pass
Makes it not say
` two garden others being upon range win
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
python 3.31items[-1]⏎```
-
python 2.86`.⏎⏎`halve(x)` returns half of x, rounded down.⏎⏎
-
agent 2.77s[-1]<|tool_end|><|assistant_start|>
-
python 2.76⏎ return s[-1]⏎```
-
python 2.66<|bos|>Bug: `half` should return half of x, rounded down, but it
-
python 2.652⏎```⏎⏎`halve` returns half of x, rounded down. For example
-
python 2.63<|bos|>Bug: `half` should return half of x, rounded down, but it
-
python 2.62⏎⏎`half(x)` returns half of x, rounded down.⏎⏎
-
python 2.59/ 2⏎⏎⏎def half(x):⏎ return x // 2⏎⏎⏎
-
agent 2.58return s[-1]<|tool_end|><|assistant_start|>
-
python 2.58return s[-1]⏎```
-
python 2.48<|assistant_end|><|bos|>`half(x)` returns half of x, rounded down.⏎⏎