Feature #2934
Fires on “ ” (not labeled yet: read the examples)
- Fires on
- 0.47% of tokens
- Mostly in
- worksheet
- Layer
- after block 4
Where it fires
- worksheet 36%
- chat 29%
- agent 29%
- story 5%
- python 2%
Makes the model say
+python language preludeuallyhello * you
Makes it not say
, whole<|bos|> Lily bag any face ask
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 2.56you tell me what 6 + 2
-
chat 2.31Could you tell me what 29 +
-
chat 2.09use the calculator.<|system_end|><|user_start|>Could you tell me what 33 + 41 is
-
worksheet 2.0591.⏎Could you tell me what 8754 + 2 is
-
worksheet 2.021791⏎Could you tell me what 44501 + 2
-
chat 1.99lemon⏎house!⏎```<|assistant_end|><|bos|><|user_start|>Could you tell me what 960 +
-
chat 1.96and went home to get warm.<|bos|><|user_start|>Could you tell me what 43 +
-
worksheet 1.96683.⏎Could you tell me what 533 + 89
-
chat 1.94The answer is 21.<|assistant_end|><|user_start|>Could you tell me what 1 + 0
-
worksheet 1.94= 33.⏎Could you tell me what 92177 +
-
worksheet 1.92add numbers.<|assistant_end|><|bos|>Could you tell me what 92242 + 4
-
worksheet 1.91666.⏎Could you tell me what 2890 + 24