Feature #2210
Fires on “.” (not labeled yet: read the examples)
- Fires on
- 0.48% of tokens
- Mostly in
- worksheet
- Layer
- after block 4
Where it fires
- worksheet 42%
- chat 28%
- story 12%
- python 11%
- agent 6%
Makes the model say
How street One if gets Msubtractutils
Makes it not say
/ the passedited n License "!"`. took
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
worksheet 7.475 = 10.⏎Max has 984 toys. Max gets 9
-
worksheet 7.2940858.⏎Tom has 743 stars. Tom gets 9
-
worksheet 7.1<|assistant_end|><|bos|>Tom has 87274 apples. Tom gets 3
-
worksheet 6.9494255.⏎Tom has 976 stars. Tom gets 6
-
worksheet 6.8995100.⏎Mia has 823 apples. Mia gets 6
-
worksheet 6.85649.⏎Mia has 85893 stars. Mia gets 6
-
worksheet 6.83100 cookies.⏎Tim has 4326 toys. Tim gets 2
-
worksheet 6.818888.⏎Anna has 6195 toys. Anna gets 2
-
worksheet 6.79= 358.⏎Sue has 474 apples. Sue gets 3
-
worksheet 6.77Have a nice day.<|assistant_end|><|bos|>Tim has 86 shells. Tim gets 7
-
worksheet 6.748687.⏎Sam has 1658 balls. Sam gets 4
-
worksheet 6.658197.⏎Lily has 3827 balls. Lily gets 7