Feature #1891
Fires on “Once” (not labeled yet: read the examples)
- Fires on
- 0.40% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 46%
- chat 30%
- agent 22%
- worksheet 2%
- python 0%
Makes the model say
idea agreed example together toould ""
Makes it not say
iB sky little moral other new fell
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 3.87.<|assistant_end|><|user_start|>I want a story about a dragon!<|user_end|><|assistant_start|>Once upon a time,
-
chat 3.75<|assistant_end|><|user_start|>can you tell me a story about a dragon<|user_end|><|assistant_start|>Once upon a time,
-
chat 3.71sentence.<|system_end|><|user_start|>I want a story about the sea!<|user_end|><|assistant_start|>Once upon a time,
-
chat 3.69sentence.<|system_end|><|user_start|>I want a story about the sea!<|user_end|><|assistant_start|>Once upon a time,
-
chat 3.67sentence.<|system_end|><|user_start|>I want a story about a boat!<|user_end|><|assistant_start|>Once upon a time,
-
chat 3.67tree.<|assistant_end|><|user_start|>I want a story about a princess!<|user_end|><|assistant_start|>Once upon a time,
-
chat 3.66helpful assistant.<|system_end|><|user_start|>Can you tell me a story?<|user_end|><|assistant_start|>Once upon a time,
-
chat 3.6513.<|assistant_end|><|user_start|>i want a story about a dog<|user_end|><|assistant_start|>Once upon a time,
-
chat 3.64sentence.<|system_end|><|user_start|>I want a story about a tree!<|user_end|><|assistant_start|>Once upon a time,
-
chat 3.63<|assistant_end|><|user_start|>can you tell me a story about a dragon<|user_end|><|assistant_start|>Once upon a time,
-
chat 3.63short sentence.<|system_end|><|user_start|>Can you tell me a story?<|user_end|><|assistant_start|>Once upon a time,
-
chat 3.63exclaim(s)`.<|assistant_end|><|bos|><|user_start|>I want a story!<|user_end|><|assistant_start|>Once upon a time,