Feature #1259
Fires on “ in” (not labeled yet: read the examples)
- Fires on
- 0.23% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 75%
- chat 10%
- agent 10%
- python 3%
- worksheet 2%
Makes the model say
We their parkWe we had moment they
Makes it not say
pleasecommandboard multipl uponexpression surePlease
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 2.71At the park, Mia
-
story 2.46tell short stories and add numbers.<|assistant_end|><|bos|>Tom and Mia were playing in the park. They
-
story 2.4in `main.py`.<|assistant_end|><|bos|>Lily and Ben are playing in the park with their
-
story 2.38` and `ops.py`.<|assistant_end|><|bos|>Tom and Lily were playing in their room. They
-
story 2.34function: `absolute(x)`.<|assistant_end|><|bos|>Tom and Lily were playing in the park. They
-
story 2.25Tim watched carefully and tried to do it too.⏎At first, Tim had
-
story 2.25items)`. The tests pass now.<|assistant_end|><|bos|>Lily and Ben are playing with blocks. They like
-
story 2.2.⏎At last, he heard
-
story 2.2day giving pieces of the fruit to everyone.⏎At the end of the day, all
-
story 2.2.<|bos|>Once upon a time, there were two little girls playing on a lawn.
-
story 2.17! Have a nice day.<|assistant_end|><|bos|>Anna and Ben were playing in the snow. They
-
story 2.15` with `increment(x)`.<|assistant_end|><|bos|>Ben and Lily were playing in the park. They