Feature #1242
"Answer" opening a system prompt
- Fires on
- 0.92% of tokens
- Mostly in
- agent
- Layer
- after block 4
Where it fires
- agent 61%
- chat 34%
- story 2%
- python 2%
- worksheet 0%
Makes the model say
elO[([codeath model **
Makes it not say
]`."⏎ alsoSo agne listen
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 2.72 for n in nums]`. The tests pass now.<|assistant_end|><|bos|><|system_start|>Answer in one short sentence
-
chat 2.68good friend. And they all lived happily ever after.<|assistant_end|><|bos|><|system_start|>Answer in one short sentence
-
chat 2.66fell asleep with a smile on her face.<|assistant_end|><|bos|><|system_start|>Answer in one short sentence
-
chat 2.61=1, 198<|think_end|>198<|assistant_end|><|bos|><|system_start|>Answer with the number only
-
agent 2.61test_math_utils.py⏎all tests passed⏎<|bos|><|system_start|>tools: edit, gl
-
chat 2.59(s)` to `core.py`.<|assistant_end|><|bos|><|system_start|>Answer in one short sentence
-
chat 2.59$ python3 app.py⏎2⏎musicmusic⏎<|bos|><|system_start|>Answer in one short sentence
-
agent 2.58python3 test_text.py⏎all tests passed⏎<|bos|><|system_start|>tools: edit, gl
-
chat 2.57nice for the dog. It was the best day ever!<|bos|><|system_start|>Answer with the number only
-
chat 2.57own little castle. And they all lived happily ever after.<|bos|><|system_start|>Answer with the number only
-
chat 2.56you like a story, or some numbers to add?<|assistant_end|><|bos|><|system_start|>Answer with the number only
-
agent 2.56python3 test_textlib.py⏎all tests passed⏎<|bos|><|system_start|>tools: edit, gl