Feature #2947
Fires on “Once” (not labeled yet: read the examples)
- Fires on
- 0.24% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 70%
- chat 26%
- agent 2%
- python 1%
- worksheet 1%
Makes the model say
theresOnce shehalg import agreed
Makes it not say
)`Rhead$ giftread Autils
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 4.98```⏎<|bos|><|user_start|>Tell me a story about a bird.<|user_end|><|assistant_start|>Once upon a time,
-
story 4.97stats.py` with `keep_even(nums)`.<|assistant_end|><|bos|>Once upon a time there
-
story 4.91py`.<|assistant_end|><|bos|>Once upon a time,
-
chat 4.86```⏎<|bos|><|user_start|>I want a story about a tree!<|user_end|><|assistant_start|>Once upon a time,
-
chat 4.8696.<|assistant_end|><|bos|><|user_start|>Once upon a time...<|user_end|><|assistant_start|>Once upon a time there
-
story 4.85=10, 105<|think_end|>105<|assistant_end|><|bos|>Once upon a time,
-
chat 4.84.<|assistant_end|><|bos|><|user_start|>Tell me a story about a fish.<|user_end|><|assistant_start|>Once upon a time,
-
chat 4.83: calculator<|system_end|><|user_start|>Tell me a story about a dragon.<|user_end|><|assistant_start|>Once upon a time,
-
story 4.83Created `utils.py` with `largest(nums)`.<|assistant_end|><|bos|>Once upon a time,
-
chat 4.83cubed<|assistant_end|><|bos|><|user_start|>Write a short story about a tree.<|user_end|><|assistant_start|>Once upon a time,
-
story 4.81hi.py`.<|assistant_end|><|bos|>Once upon a time,
-
chat 4.799<|assistant_end|><|bos|><|user_start|>I want a story about a fish!<|user_end|><|assistant_start|>Once upon a time,