Feature #3831
Fires on “Once” (not labeled yet: read the examples)
- Fires on
- 0.38% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 43%
- chat 27%
- agent 25%
- worksheet 4%
- python 1%
Makes the model say
ultipl:<|assistant_end|>command "$ python filescount
Makes it not say
fromNoRnh too while brave
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 3.33with `final_letter(s)`.<|assistant_end|><|bos|>Once upon a time,
-
story 3.22 for n in nums]`. The tests pass now.<|assistant_end|><|bos|>Once upon a time,
-
story 3.19)` multiplies all the numbers from 1 to n.<|assistant_end|><|bos|>Once upon a time,
-
story 3.19=10, 105<|think_end|>105<|assistant_end|><|bos|>Once upon a time,
-
story 3.19, 82<|think_end|>The answer is 82.<|assistant_end|><|bos|>Once upon a time,
-
story 3.17, 88<|think_end|>The answer is 88.<|assistant_end|><|bos|>Once upon a time,
-
story 3.16=13, 136<|think_end|>136<|assistant_end|><|bos|>Once upon a time,
-
story 3.143+0=3, 39<|think_end|>39<|assistant_end|><|bos|>Once upon a time,
-
story 3.12now prints:⏎```⏎r⏎tac⏎```<|assistant_end|><|bos|>Once upon a time,
-
story 3.10=8, 843<|think_end|>843<|assistant_end|><|bos|>Once upon a time,
-
story 3.1122<|think_end|>The answer is 122.<|assistant_end|><|bos|>Once upon a time,
-
story 3.09test_ops.py` passes: all tests passed.<|assistant_end|><|bos|>Once upon a time,