Feature #2286
Fires on “.” (not labeled yet: read the examples)
- Fires on
- 0.21% of tokens
- Mostly in
- worksheet
- Layer
- after block 4
Where it fires
- worksheet 64%
- agent 26%
- story 5%
- python 4%
- chat 1%
Makes the model say
?⏎⏎=⏎ pyO sees?"
Makes it not say
great so perfect9 bright tree nearby kept
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
worksheet 1.3746 + 0 = 46.⏎Lucy had
-
worksheet 1.34So 5 + 7 = 12.<|bos|><|system_start|>tools:
-
worksheet 1.339 + 1 = 10.⏎Max has
-
worksheet 1.3329 = 84.⏎432
-
worksheet 1.329⏎So 69 + 10 = 79.⏎686
-
worksheet 1.26⏎So 48 + 23 = 71.⏎3+4
-
worksheet 1.2320⏎So 7 + 13 = 20.⏎9 plus
-
worksheet 1.2349 = 53.<|bos|>899
-
worksheet 1.2246⏎So 1 + 45 = 46.⏎If you add
-
worksheet 1.2212⏎So 4 + 8 = 12.⏎731
-
worksheet 1.22equals 74.⏎What's
-
worksheet 1.213 = 560.⏎What is