Feature #3124
Fires on “.” (not labeled yet: read the examples)
- Fires on
- 0.68% of tokens
- Mostly in
- worksheet
- Layer
- after block 4
Where it fires
- worksheet 51%
- chat 43%
- agent 2%
- story 2%
- python 1%
Makes the model say
to⏎ +main.print but,
Makes it not say
thanked listenedpath greeting edit<|system_start|>asebiggest
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
worksheet 2.73The sum of 96 and 8 is 104.⏎Ben had
-
worksheet 2.66So 75 + 340 = 415.<|bos|><|system_start|>tools:
-
worksheet 2.6476 and 6227 is 9003.⏎If you add
-
worksheet 2.649 + 252 = 261.⏎Hey, what
-
worksheet 2.64079 plus 28 equals 17107.⏎Could you tell
-
worksheet 2.613 and 5179 is 5182.⏎8 plus
-
worksheet 2.59⏎7 plus 3964 is 3971.⏎The sum of
-
worksheet 2.59987 and 408 is 1395.⏎151
-
worksheet 2.5917 + 1669 = 1686.⏎I need to
-
worksheet 2.59<|assistant_end|><|bos|>63 plus 871 is 934.⏎403
-
worksheet 2.5987 plus 4248 equals 5235.⏎12 +
-
worksheet 2.58numbers.<|assistant_end|><|bos|>30 plus 20 equals 50.⏎Compute 6