Feature #1829
Fires on โ<|bos|>โ (not labeled yet: read the examples)
- Fires on
- 0.65% of tokens
- Mostly in
- chat
- Layer
- after block 4
Where it fires
- chat 29%
- story 26%
- agent 25%
- python 10%
- worksheet 10%
Makes the model say
hOnce then big p "rโ
Makes it not say
SetpatholdString`,=**/ Sorry agent
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 13.83they had a fun day playing with the treasure in the park.<|assistant_end|><|bos|>Once upon a time
-
chat 13.73instead of `if a > b:`. The tests pass now.<|assistant_end|><|bos|><|system_start|>Start every answer
-
agent 13.62that. I only know how to tell stories and add numbers.<|assistant_end|><|bos|><|system_start|>tools: edit
-
chat 13.6tiny model: I can only tell short stories and add numbers.<|assistant_end|><|bos|><|user_start|>How can you
-
agent 13.59instead of `if a > b:`. The tests pass now.<|assistant_end|><|bos|><|system_start|>tools: edit
-
agent 13.58instead of `if a > b:`. The tests pass now.<|assistant_end|><|bos|><|system_start|>tools: edit
-
story 13.55make everyone happy, even when things don't go as planned.<|bos|>Once upon a time
-
chat 13.55n % 2 == 0]`. The tests pass now.<|assistant_end|><|bos|><|system_start|>tools: calculator
-
python 13.55the Python files in this project.<|assistant_end|><|bos|># app.py
-
chat 13.54instead of `if a > b:`. The tests pass now.<|assistant_end|><|bos|><|system_start|>tools: calculator
-
story 13.54n % 2 == 0]`. The tests pass now.<|assistant_end|><|bos|>Once upon a time
-
python 13.53others can make a place even more special, and bring you joy.<|bos|># app.py