Feature #3985
Fires on “Write” (not labeled yet: read the examples)
- Fires on
- 0.24% of tokens
- Mostly in
- agent
- Layer
- after block 4
Where it fires
- agent 43%
- chat 37%
- python 12%
- story 8%
- worksheet 0%
Makes the model say
ce themoldStringsef getting not sum
Makes it not say
.defappy2 girl0 and while
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 3.8on his back, as they had many fun adventures together.<|bos|><|user_start|>Write a short story about
-
chat 3.74her face.<|assistant_end|><|bos|><|system_start|>Answer in one short sentence.<|system_end|><|user_start|>Write a short story about
-
chat 3.68and help others.<|bos|><|system_start|>Answer in one short sentence.<|system_end|><|user_start|>Write a story for me
-
chat 3.68but he always had fun with his friends in the woods.<|bos|><|user_start|>Write a short story about
-
chat 3.65little while, they forgot about the war and were happy.<|bos|><|user_start|>Write a story for me
-
chat 3.657853 = 77853.<|bos|><|user_start|>Write a short story about
-
chat 3.63ready have.<|bos|><|system_start|>Answer in one short sentence.<|system_end|><|user_start|>Write a short story about
-
chat 3.57!<|user_end|><|assistant_start|>Goodbye! Have a nice day.<|assistant_end|><|user_start|>Write a short story about
-
chat 3.57it was too late. Her fine toy was gone forever.<|bos|><|user_start|>Write a short story about
-
chat 3.53a big dragon. The dragon was very organized.<|assistant_end|><|user_start|>Write a short story about
-
chat 3.53Thank you very much!<|user_end|><|assistant_start|>Happy to help!<|assistant_end|><|user_start|>Write a short story about
-
chat 3.53best of friends forever.<|bos|><|user_start|>Write a short story about