Feature #4005
Fires on “ tell” (not labeled yet: read the examples)
- Fires on
- 0.31% of tokens
- Mostly in
- chat
- Layer
- after block 4
Where it fires
- chat 58%
- story 22%
- agent 13%
- worksheet 5%
- python 3%
Makes the model say
a your help me my welcome his(
Makes it not say
ell Falseasananaklsptvowels
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 4.71't like to play with the other boats.<|assistant_end|><|user_start|>Can you tell me a story?
-
chat 4.61<|user_start|>Can you tell me a story about
-
chat 4.55.<|assistant_end|><|bos|><|system_start|>You are a helpful assistant.<|system_end|><|user_start|>Can you tell me a story?
-
chat 4.51<|user_end|><|assistant_start|>The answer is 815.<|assistant_end|><|user_start|>Can you tell me a story about
-
chat 4.49only know how to tell stories and add numbers.<|assistant_end|><|user_start|>Can you tell me a story?
-
chat 4.44tests pass now.<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>Can you tell me a story about
-
chat 4.38.<|assistant_end|><|bos|><|system_start|>Answer in one short sentence.<|system_end|><|user_start|>Can you tell me a story?
-
chat 4.35they played together happily.<|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>Can you tell me a story?
-
chat 4.22toys.<|bos|><|system_start|>Answer in one short sentence.<|system_end|><|user_start|>Can you tell me a story about
-
chat 4.22.py` with `initial(s)`.<|assistant_end|><|bos|><|user_start|>Can you tell me a story about
-
chat 4.22: calculator<|system_end|><|system_start|>You are a helpful assistant.<|system_end|><|user_start|>Can you tell me a story about
-
chat 4.20<|think_end|>The answer is 10.<|assistant_end|><|bos|><|user_start|>Can you tell me a story?