Feature #3126
Fires on “ a” (not labeled yet: read the examples)
- Fires on
- 0.35% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 71%
- chat 24%
- agent 2%
- python 2%
- worksheet 1%
Makes the model say
time)` fun`"`.3 while boy
Makes it not say
tail somethingOh<|bos|> thing Andected things
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 3.94Can you tell me a story about a car?<|user_end|><|assistant_start|>Once upon a time, there was
-
story 3.85<|tool_end|><|assistant_start|>The answer is 257.<|assistant_end|><|bos|>Once upon a time there was an
-
chat 3.85<|system_end|><|user_start|>I want a story about the sea!<|user_end|><|assistant_start|>Once upon a time, in a
-
story 3.85<|tool_end|><|assistant_start|>The answer is 125.<|assistant_end|><|bos|>Once upon a time, there was
-
story 3.845<|tool_end|><|assistant_start|>The answer is 25.<|assistant_end|><|bos|>Once upon a time, there was
-
chat 3.84you tell me a story about a fish?<|user_end|><|assistant_start|>Once upon a time, in a
-
chat 3.82.<|system_end|><|user_start|>Can you tell me a story?<|user_end|><|assistant_start|>Once upon a time, there was
-
chat 3.82Can you tell me a story about the sea?<|user_end|><|assistant_start|>Once upon a time, there was
-
chat 3.81<|assistant_end|><|user_start|>Tell me a story about a dragon.<|user_end|><|assistant_start|>Once upon a time, there was
-
chat 3.8<|assistant_end|><|user_start|>I want a story about a dragon!<|user_end|><|assistant_start|>Once upon a time, there was
-
story 3.84<|tool_end|><|assistant_start|>The answer is 74.<|assistant_end|><|bos|>Once upon a time, in a
-
story 3.79<|tool_end|><|assistant_start|>The answer is 261.<|assistant_end|><|bos|>Once upon a time there was a