Feature #2218
Fires on “ in” (not labeled yet: read the examples)
- Fires on
- 0.91% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 68%
- chat 27%
- worksheet 2%
- agent 2%
- python 1%
Makes the model say
a an in townOne One Mr kind
Makes it not say
contentreplaceAll he<|assistant_end|>expression generatorCreatedw
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 5.29Once upon a time, in a big sky,
-
story 5.22<|bos|>Once upon a time, there was a big giant. He lived in a huge, expensive
-
story 5.2upon a time, in a big forest,
-
story 5.18<|bos|>Once upon a time, in a big garden,
-
story 5.13495<|assistant_end|><|bos|>Once upon a time, in a small house near
-
story 5.08<|bos|>Once upon a time, there was a girl named Lucy. She had a pretty unif
-
story 4.95<|bos|>Once upon a time, there was a girl named Lily. She had a big box of
-
chat 4.89<|user_end|><|assistant_start|>Once upon a time, in a cheerful forest
-
chat 4.88<|assistant_start|>Once upon a time, there was a princess. She lived in a big, pretty
-
story 4.87<|bos|>Once upon a time, there was a small princess. She lived in a big castle with
-
story 4.84to show everyone back home!<|bos|>Once upon a time, in a small village,
-
story 4.83ing colors and playing together.<|bos|>Once upon a time, in a big forest,