Feature #2945
Fires on “⏎” (not labeled yet: read the examples)
- Fires on
- 0.22% of tokens
- Mostly in
- worksheet
- Layer
- after block 4
Where it fires
- worksheet 89%
- story 8%
- chat 2%
- agent 1%
- python 0%
Makes the model say
<|bos|>. says." sleep lived1 tell
Makes it not say
ak minusmath))ing He equalsnder
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
worksheet 3.35+ 8967 = 54704.⏎0 + 7
-
worksheet 3.343 + 2861 = 6314.⏎382 plus
-
worksheet 3.32+ 5484 = 15465.⏎If you add
-
worksheet 3.3248698 = 49516.⏎Sam had 6
-
worksheet 3.319 + 6674 = 8953.⏎Max had 5
-
worksheet 3.36 + 4474 = 9880.⏎877 plus
-
worksheet 3.3413 + 90 = 4503.⏎Tom had 3
-
worksheet 3.344877 = 50274.⏎7208
-
worksheet 3.29+ 4677 = 13362.⏎what is 9
-
worksheet 3.29+ 3008 = 49295.⏎If you add
-
worksheet 3.289 + 8547 = 9536.⏎Hey, what's
-
worksheet 3.2788 + 272 = 360.⏎6263