Feature #1055
Fires on “ ” (not labeled yet: read the examples)
- Fires on
- 0.66% of tokens
- Mostly in
- worksheet
- Layer
- after block 4
Where it fires
- worksheet 69%
- chat 29%
- python 1%
- story 0%
- agent 0%
Makes the model say
86271)`. camede
Makes it not say
helpant⏎ breath hugged outside met<|bos|>
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
worksheet 4.16536 is 1545.⏎69 plus 64 is
-
worksheet 4.07= 1377⏎Ben had 41 apples and
-
worksheet 4.064400.⏎Anna had 90 cookies and found 8 more. Now
-
worksheet 4.0457 = 9622.⏎93 + 1463
-
worksheet 4.0109.<|assistant_end|><|bos|>Lily had 70 flowers and found 68 more.
-
worksheet 3.97. Now Sue has 170 flowers.⏎88 + 18 = ?
-
worksheet 3.970 = 36224.⏎789 + 6 = 7
-
worksheet 3.9668 = 67625.⏎99 + 472 =
-
worksheet 3.963757⏎Anna had 263 flowers and found 1465
-
worksheet 3.9501 = 61942.⏎83 + 11⏎8
-
worksheet 3.9408 = 61718.⏎49 plus 530 is
-
worksheet 3.941 = 109878.⏎Calculate 576 +