Feature #2796
Fires on “,” (not labeled yet: read the examples)
- Fires on
- 1.45% of tokens
- Mostly in
- agent
- Layer
- after block 4
Where it fires
- agent 82%
- story 14%
- chat 4%
- python 0%
- worksheet 0%
Makes the model say
it one shiny but Ione small what
Makes it not say
treeng laughed statsice lateoldStringTim
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
agent 2.8search, write, exe
-
agent 2.8search, write, exe
-
agent 2.8search, write, exe
-
agent 2.8search, write, exe
-
agent 2.8search, write, exe
-
agent 2.8search, write, exe
-
agent 2.8search, write, exe
-
agent 2.8search, write, exe
-
agent 2.8search, write, exe
-
agent 2.8search, write, exe
-
story 2.65sizes. But Ben's favorite truck was an enormous red one. It had big
-
story 2.64Sam. She finds some beads that are blue and green, like Sam's eyes