Feature #1365
Fires on “7” (not labeled yet: read the examples)
- Fires on
- 1.17% of tokens
- Mostly in
- worksheet
- Layer
- after block 4
Where it fires
- worksheet 77%
- chat 14%
- story 6%
- agent 3%
- python 1%
Makes the model say
47fact<|bos|>ful_$ats
Makes it not say
., soon fromg atutils fix
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
worksheet 3.097875 and 61 for me?⏎7875+00
-
worksheet 3.011037 plus 280?⏎1037+02
-
worksheet 2.965357 + 4861.⏎5357+48
-
worksheet 2.956778 + 2728.⏎6778+27
-
worksheet 2.944525 + 448.⏎4525+04
-
worksheet 2.944686 + 6644?⏎4686+66
-
worksheet 2.979 and 7001 for me?⏎6379+70
-
worksheet 2.87is 323 + 406?⏎323+406
-
worksheet 2.846777 and 8740.⏎6777+87
-
worksheet 2.837145 + 859?⏎7145+08
-
worksheet 2.812364 + 6237?⏎2364+62
-
worksheet 2.81is 4927 + 42?⏎4927+00