Feature #1463
Fires on “ a” (not labeled yet: read the examples)
- Fires on
- 0.26% of tokens
- Mostly in
- python
- Layer
- after block 4
Where it fires
- python 54%
- agent 24%
- chat 18%
- story 4%
- worksheet 0%
Makes the model say
ispython was4's wagged help to
Makes it not say
⏎ :`.}schema named⏎⏎nameten
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 2.62best of friends forever.<|bos|><|user_start|>Write a short story about the
-
chat 2.585<|think_end|>The answer is 105.<|assistant_end|><|bos|><|user_start|>Write a short story about a
-
chat 2.56tools.py` passes: all tests passed.<|assistant_end|><|bos|><|user_start|>Write a short story about a
-
chat 2.54853 = 77853.<|bos|><|user_start|>Write a short story about a
-
chat 2.52while, they forgot about the war and were happy.<|bos|><|user_start|>Write a story for me.
-
chat 2.5191<|think_end|>91<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>Write a short story about a
-
chat 2.47I can only tell short stories and add numbers.<|assistant_end|><|bos|><|user_start|>Write a short story about the
-
chat 2.468 = 566<|bos|><|user_start|>Write a short story about the
-
chat 2.44False`.⏎<|bos|><|system_start|>Answer in one short sentence.<|system_end|><|user_start|>Write a short story about a
-
chat 2.44his back, as they had many fun adventures together.<|bos|><|user_start|>Write a short story about a
-
chat 2.43x.<|assistant_end|><|bos|><|system_start|>Answer in one short sentence.<|system_end|><|user_start|>Write a short story about the
-
chat 2.42help others.<|bos|><|system_start|>Answer in one short sentence.<|system_end|><|user_start|>Write a story for me.