Feature #1872
Fires on “ small” (not labeled yet: read the examples)
- Fires on
- 0.21% of tokens
- Mostly in
- python
- Layer
- after block 4
Where it fires
- python 41%
- story 29%
- chat 25%
- agent 3%
- worksheet 2%
Makes the model say
from2⏎opencode yearsdouble5 factorial
Makes it not say
" becauseist if how at: watch
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 3.63495<|assistant_end|><|bos|>Once upon a time, in a small house near the big
-
story 3.52rest of the nice day.<|bos|>Once upon a time, in a small town, there lived
-
story 3.43I help you today?<|assistant_end|><|bos|>Once upon a time, in a small town, there was
-
story 3.42to show everyone back home!<|bos|>Once upon a time, in a small village, there was
-
story 3.42s + "!"⏎```⏎<|bos|>Once upon a time, in a small house, lived a
-
story 3.41get rewards for trying.<|bos|>Once upon a time, in a small town, there lived
-
story 3.39stories and add numbers.<|assistant_end|><|bos|>Once upon a time, in a small town, there lived
-
chat 3.38story.<|user_end|><|assistant_start|>Sure! Once upon a time, in a small house, there was
-
story 3.37me for a story!<|assistant_end|><|bos|>Once upon a time, in a small house, there was
-
story 3.35they played happily ever after.<|bos|>Once upon a time, in a small town, there was
-
story 3.34is 74.<|assistant_end|><|bos|>Once upon a time, in a small town, there was
-
story 3.34498.<|assistant_end|><|bos|>Once upon a time, in a small house, lived a