Feature #2490
Fires on “ up” (not labeled yet: read the examples)
- Fires on
- 0.16% of tokens
- Mostly in
- python
- Layer
- after block 4
Where it fires
- python 37%
- story 25%
- agent 21%
- worksheet 12%
- chat 6%
Makes the model say
flew both"`. help two many Let forgive
Makes it not say
It it text its P main plus win
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 1.93under a big tree and
-
story 1.77up.⏎Just then
-
story 1.77up on its own.
-
chat 1.77up late. The bird
-
story 1.77up and dipped it
-
chat 1.77up late. The bird
-
chat 1.69by step or with a calculator
-
story 1.54stadium. She loved
-
story 1.4give me my penny back."
-
agent 1.39from text import final_letter
-
python 1.38, 6, 3, 7, 7]) == 30⏎print
-
agent 1.23Hello!"<|user_end|><|assistant_start|>Hi