Feature #895
Fires on “ qu” (not labeled yet: read the examples)
- Fires on
- 0.40% of tokens
- Mostly in
- agent
- Layer
- after block 4
Where it fires
- agent 51%
- story 27%
- chat 19%
- python 3%
- worksheet 1%
Makes the model say
was help into bestfortableOnce+ant
Makes it not say
runion4appopsHe " he
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 3.09is 31.<|bos|>One day, Fred the cat was feeling quite nosy. He
-
chat 2.57scratch on a laptop by mini-lab.<|assistant_end|><|bos|><|user_start|>Explain quantum phy
-
story 2.56em.⏎Lily had a little brother named Tom. Tom was feeling helpless because he could
-
chat 2.55The pink witch had a good day.<|assistant_end|><|bos|><|user_start|>Explain quantum phy
-
chat 2.55test_lib.py⏎all tests passed⏎<|bos|><|user_start|>Explain quantum phy
-
story 2.54said, "Well George, it's a bit complicated to
-
story 2.53a blanket. They sipped their cocoa and felt warm and comfortable. They smiled
-
story 2.51. Tom changed into his new outfit and felt much more comfortable.⏎Mia
-
chat 2.44?<|user_end|><|assistant_start|>The answer is 11.<|assistant_end|><|user_start|>Explain quantum phy
-
chat 2.41found a mint plant in the yard.<|assistant_end|><|bos|><|user_start|>Explain quantum phy
-
story 2.39⏎Tim and Sam drank some tea together. Tim felt very happy and comforted. They
-
chat 2.34scratch on a laptop by mini-lab.<|assistant_end|><|bos|><|user_start|>Explain quantum phy