Feature #2892
Fires on “.” (not labeled yet: read the examples)
- Fires on
- 0.15% of tokens
- Mostly in
- worksheet
- Layer
- after block 4
Where it fires
- worksheet 76%
- chat 10%
- story 6%
- python 4%
- agent 4%
Makes the model say
<|assistant_end|>⏎ Now Tim noisei Fin checks
Makes it not say
: So someA so something hello moment
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
worksheet 4.65found 554 more. Now Anna has
-
worksheet 4.6.<|bos|>Max had 2 stars and found 176 more. Now Max has
-
worksheet 4.48had 41 apples and found 38056 more. Now Ben has
-
worksheet 4.44.⏎Max had 5 shells and found 603 more. Now Max has
-
worksheet 4.41733 balls and found 73860 more. Now Sue has
-
worksheet 4.42182 stars and found 23233 more. Now Tim has
-
worksheet 4.33.⏎Sam had 7 stickers and found 706 more. Now Sam has
-
worksheet 4.31Tim had 96 balls and found 7280 more. Now Tim has
-
worksheet 4.31Tom had 5 toys and found 41886 more. Now Tom has
-
worksheet 4.318712 toys and found 5401 more. Now Sue has
-
worksheet 4.29Anna had 7 stickers and found 68993 more. Now Anna has
-
worksheet 4.28Lily had 16 balls and found 9947 more. Now Lily has