Feature #989
Fires on “What” (not labeled yet: read the examples)
- Fires on
- 0.54% of tokens
- Mostly in
- chat
- Layer
- after block 4
Where it fires
- chat 51%
- worksheet 19%
- agent 19%
- story 9%
- python 1%
Makes the model say
is new they happened noise's I
Makes it not say
], down continuedpytest underop ground5
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
worksheet 5.56equals 74.⏎What's 81
-
worksheet 5.443 = 560.⏎What is 10
-
worksheet 5.178 plus 9 equals 37.⏎What is 50
-
worksheet 4.948 + 6 = 22314.⏎What is the sum of
-
worksheet 4.85366 + 5 = 371.⏎What's 55
-
worksheet 4.845 more. Now Lily has 1370 books.⏎What is the sum of
-
chat 4.82, edit and fix the Python files in this project.<|assistant_end|><|bos|><|user_start|>What can you do?
-
worksheet 4.884 is 10661.⏎What is 2 +
-
chat 4.782288 = 2353.<|bos|><|user_start|>What is 1 +
-
chat 4.75I only know how to tell stories and add numbers.<|assistant_end|><|bos|><|user_start|>What is the sum of
-
worksheet 4.743150 = 88009.⏎What is the sum of
-
chat 4.739 + 844 = 853.<|bos|><|user_start|>What's the weather