Feature #1751
Fires on “1” (not labeled yet: read the examples)
- Fires on
- 0.26% of tokens
- Mostly in
- python
- Layer
- after block 4
Where it fires
- python 38%
- story 27%
- agent 19%
- worksheet 12%
- chat 3%
Makes the model say
],, gre Ben mess same<|tool_call_start|> living
Makes it not say
sooniceyinslies keptprintThey
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
python 6.58`has_item([4, 5, 5, 4], 4)`
-
python 6.56assert has_item([1, 0, 2, 1], 9)
-
python 6.19>>> has_item([1, 4, 5, 1], 4)
-
python 6.03(has_item([6, 9, 5, 8], 5))
-
python 6.03⏎⏎>>> includes([2, 6, 3, 6, 5],
-
python 5.94⏎print(contains([5, 8, 7, 1], 7))
-
python 5.85⏎⏎>>> contains([2, 8, 7, 7], 1)
-
python 5.8⏎⏎assert contains([9, 0, 4, 2, 0],
-
python 5.77assert has_item([5, 0, 6, 8, 2],
-
python 5.73⏎⏎>>> includes([0, 8, 6, 8, 8],
-
python 5.66⏎print(contains([9, 2, 5, 2], 2))
-
python 5.63example, `contains([4, 4, 5, 0, 0],