Feature #1595
Fires on “ were” (not labeled yet: read the examples)
- Fires on
- 0.26% of tokens
- Mostly in
- agent
- Layer
- after block 4
Where it fires
- agent 25%
- story 22%
- worksheet 18%
- chat 18%
- python 17%
Makes the model say
both many twoumpreturn donereplaceAll all
Makes it not say
addsdivides had "!"Once: it was
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 3.87`.⏎<|bos|>Once upon a time, in a beautiful land, there were many colors. The
-
story 3.76.<|assistant_end|><|bos|>Once upon a time there were two children, Joe
-
story 3.73a time, there was a colorful farm. On this farm, there were many animals. The
-
story 3.67time, there was a mighty big farm. On this farm, there were many animals who liked
-
story 3.59a time, there was a small pond. In the pond, there were many fish. A
-
story 3.55was a big red barn on a farm. In the barn, there were many animals. One
-
story 3.45big university. In this university, there were many kids who liked
-
story 3.42, he could do anything he wanted!<|bos|>Once upon a time there were two best friends,
-
story 3.42upon a time there were two shapes. One
-
story 3.39the snow all day.<|bos|>Once upon a time, there were two friends called A
-
story 3.33, there was a big hall. In the hall, there were many toys. Some
-
story 3.3<|think_end|>The answer is 6.<|assistant_end|><|bos|>Once upon a time there were two friends, a