Feature #979
Fires on “4” (not labeled yet: read the examples)
- Fires on
- 1.66% of tokens
- Mostly in
- worksheet
- Layer
- after block 4
Where it fires
- worksheet 60%
- agent 16%
- chat 14%
- python 8%
- story 3%
Makes the model say
<|assistant_end|>min9 plusodd) Maxde
Makes it not say
they TheyTheys.as`. them
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
worksheet 4.764 = 115585.
-
worksheet 4.397744 + 608 = 18352.
-
worksheet 4.3684 is 10661.⏎What
-
chat 4.314, 494<|think_end|>The answer
-
worksheet 4.296 = 1560.⏎
-
agent 4.264, 4, 4, 7,
-
python 4.215, 5, 8, 9]
-
worksheet 4.211930 + 6958 = 18888.⏎
-
python 4.26, 1, 4, 0],
-
python 4.135, 2, 4]))⏎print(
-
agent 4.123, 7, 9]) == [6
-
worksheet 4.111 + 86 = 147.<|bos|>Can