Feature #3069
Fires on “ there” (not labeled yet: read the examples)
- Fires on
- 0.65% of tokens
- Mostly in
- chat
- Layer
- after block 4
Where it fires
- chat 41%
- story 40%
- agent 13%
- python 5%
- worksheet 1%
Makes the model say
pythonitemslastmin<|think_start|> pythonbanana
Makes it not say
. next And other best different most:
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
agent 2.45<|user_start|>"Why does main.
-
story 2.3<|bos|>One day, a little ball
-
chat 2.21<|bos|><|user_start|>Tell me a story.<|user_end|><|assistant_start|>Once upon a time, there was a dog.
-
chat 2.19<|user_end|><|assistant_start|>One day, a little dog
-
chat 2.16<|user_start|>Tell me a short story.<|user_end|><|assistant_start|>Once upon a time, there was a little boy
-
chat 2.11Can you tell me a story?<|user_end|><|assistant_start|>Once upon a time, there was a little dog
-
agent 2.09tail(items)` and `mean_list(nums)`.<|assistant_end|><|user_start|>"set NUMBERS to [
-
story 2.08<|assistant_end|><|bos|>Once upon a time, there was a big giant
-
chat 2.08<|assistant_end|><|bos|><|user_start|>Tell me a story about the park.<|user_end|><|assistant_start|>One day, a little girl
-
chat 2.07<|assistant_end|><|bos|><|user_start|>I want a story about a cat!<|user_end|><|assistant_start|>One day, a big cat
-
story 2.06<|bos|>Once upon a time, there was a little car
-
story 2.06<|bos|>Once upon a time, there was a little girl