Feature #384
Fires on “Once” (not labeled yet: read the examples)
- Fires on
- 0.20% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 70%
- chat 29%
- agent 0%
- python 0%
- worksheet 0%
Makes the model say
uponOnce example be⏎ ⏎ <|tool_end|> moral
Makes it not say
hardsO theirn its last our
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 5.4214.<|bos|><|user_start|>Tell me a short story.<|user_end|><|assistant_start|>Once upon a time,
-
chat 5.41cubed<|assistant_end|><|bos|><|user_start|>Write a short story about a tree.<|user_end|><|assistant_start|>Once upon a time,
-
story 5.35665<|think_end|>The answer is 665.<|assistant_end|><|bos|>Once upon a time,
-
chat 5.33short sentence.<|system_end|><|user_start|>Can you tell me a story?<|user_end|><|assistant_start|>Once upon a time,
-
chat 5.33438<|bos|><|user_start|>Can you tell me a story?<|user_end|><|assistant_start|>Once upon a time,
-
chat 5.3<|system_end|><|user_start|>Can you tell me a story about a tree?<|user_end|><|assistant_start|>Once upon a time,
-
chat 5.3helpful assistant.<|system_end|><|user_start|>Can you tell me a story?<|user_end|><|assistant_start|>Once upon a time,
-
chat 5.3small and friendly assistant.<|system_end|><|user_start|>I want a story!<|user_end|><|assistant_start|>Once upon a time,
-
chat 5.28.<|assistant_end|><|bos|><|user_start|>Tell me a story about a cat.<|user_end|><|assistant_start|>Once upon a time,
-
chat 5.28<|assistant_end|><|user_start|>can you tell me a story about a dog<|user_end|><|assistant_start|>Once upon a time,
-
chat 5.28sentence.<|system_end|><|user_start|>I want a story about the sea!<|user_end|><|assistant_start|>Once upon a time,
-
chat 5.27sentence.<|system_end|><|user_start|>Tell me a story about a ball.<|user_end|><|assistant_start|>Once upon a time,