Feature #615
Fires on “ent” (not labeled yet: read the examples)
- Fires on
- 0.18% of tokens
- Mostly in
- agent
- Layer
- after block 4
Where it fires
- agent 97%
- story 3%
- chat 0%
- python 0%
- worksheet 0%
Makes the model say
s great little by newful helpers bright
Makes it not say
#<|user_start|> Lily==**/*._*. typo wanted
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
agent 3.91grep, question, read, shell, skill, subagent, webf
-
agent 3.87grep, question, read, shell, skill, subagent, webf
-
agent 3.87grep, question, read, shell, skill, subagent, webf
-
agent 3.85grep, question, read, shell, skill, subagent, webf
-
agent 3.81grep, question, read, shell, skill, subagent, webf
-
agent 3.81grep, question, read, shell, skill, subagent, webf
-
agent 3.8grep, question, read, shell, skill, subagent, webf
-
agent 3.79grep, question, read, shell, skill, subagent, webf
-
agent 3.79grep, question, read, shell, skill, subagent, webf
-
agent 3.79grep, question, read, shell, skill, subagent, webf
-
agent 3.79grep, question, read, shell, skill, subagent, webf
-
agent 3.79grep, question, read, shell, skill, subagent, webf