Feature #1812
Fires on “ what” (not labeled yet: read the examples)
- Fires on
- 0.50% of tokens
- Mostly in
- chat
- Layer
- after block 4
Where it fires
- chat 42%
- worksheet 26%
- story 18%
- agent 12%
- python 1%
Makes the model say
pya's<|system_end|>pythonSueyway
Makes it not say
the⏎ so to his t a its
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
worksheet 6.26+ 252 = 261.⏎Hey, what's 4 plus
-
worksheet 5.82879 = 10564.⏎Hey, what's 28
-
worksheet 5.73equals 74.⏎What's 81
-
worksheet 5.711537 = 1556.⏎Hey, what's 7 plus
-
worksheet 5.66+ 1 = 40379.⏎Hey, what's 40
-
worksheet 5.57<|tool_end|><|assistant_start|>The answer is 198.<|assistant_end|><|bos|>Hey, what's 79
-
worksheet 5.57+ 73 = 8880.⏎Hey, what's 4 plus
-
worksheet 5.551<|think_end|>The answer is 411.<|assistant_end|><|bos|>Hey, what's 88
-
worksheet 5.52+ 399 = 595.⏎Hey, what's 23
-
worksheet 5.5817 is 69819.<|bos|>Hey, what's 0 plus
-
worksheet 5.5652 = 29657.⏎Hey, what's 64
-
worksheet 5.488547 = 9536.⏎Hey, what's 10