Feature #1147
Fires on “ number” (not labeled yet: read the examples)
- Fires on
- 0.47% of tokens
- Mostly in
- worksheet
- Layer
- after block 4
Where it fires
- worksheet 33%
- chat 29%
- agent 25%
- python 9%
- story 4%
Makes the model say
_ problemon countL brother of trees
Makes it not say
4 plus3 "!" passesbedperedance
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 3.91 function: `tail(items)`.<|assistant_end|><|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>
-
chat 3.73198<|think_end|>198<|assistant_end|><|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>
-
chat 3.72a + " " + b⏎```⏎<|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>
-
chat 3.72story, or some numbers to add?<|assistant_end|><|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>
-
chat 3.7583<|think_end|>583<|assistant_end|><|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>
-
chat 3.69answer is 1706.<|assistant_end|><|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>
-
python 3.69gone forever, and the town was never the same again.<|bos|># number_utils.py
-
chat 3.69):⏎ return x in items⏎```⏎<|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>
-
chat 3.68, ready for another day of fun together.<|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>
-
chat 3.656 = 98926.<|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>
-
chat 3.64⏎```<|assistant_end|><|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>
-
chat 3.62(s)`. The tests pass now.<|assistant_end|><|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>