Feature #3224
Fires on “ upon” (not labeled yet: read the examples)
- Fires on
- 0.65% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 60%
- chat 29%
- python 6%
- agent 4%
- worksheet 1%
Makes the model say
` courseOnefe alower uponreturn
Makes it not say
not of things toys<|assistant_end|> small lot toy
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 4.357.<|assistant_end|><|bos|><|system_start|>Answer in one short sentence.<|system_end|><|user_start|>Once upon a time...
-
chat 4.32ats.<|assistant_end|><|user_start|>Can you tell me a story?<|user_end|><|assistant_start|>Once upon a time, there
-
chat 4.32.<|assistant_end|><|user_start|>tell me a story about a boat<|user_end|><|assistant_start|>Once upon a time, there
-
chat 4.3.<|system_end|><|user_start|>I want a story about a boat!<|user_end|><|assistant_start|>Once upon a time, there
-
chat 4.3<|user_start|>Can you tell me a story about the sea?<|user_end|><|assistant_start|>Once upon a time, there
-
chat 4.29<|assistant_end|><|bos|><|user_start|>Write a short story about a tree.<|user_end|><|assistant_start|>Once upon a time, there
-
chat 4.28.<|assistant_end|><|user_start|>I want a story about a dragon!<|user_end|><|assistant_start|>Once upon a time, there
-
chat 4.26numbers.<|assistant_end|><|bos|><|user_start|>Tell me a short story.<|user_end|><|assistant_start|>Once upon a time, there
-
chat 4.25about a dragon.<|user_end|><|assistant_start|>Once upon a time, there
-
chat 4.25.<|assistant_end|><|user_start|>I want a story about a cat!<|user_end|><|assistant_start|>Once upon a time, there
-
chat 4.25assistant.<|system_end|><|user_start|>Can you tell me a story?<|user_end|><|assistant_start|>Once upon a time, there
-
chat 4.25.<|assistant_end|><|user_start|>Tell me a story about a dragon.<|user_end|><|assistant_start|>Once upon a time, there