Feature #2528
Fires on “ saw” (not labeled yet: read the examples)
- Fires on
- 0.82% of tokens
- Mostly in
- agent
- Layer
- after block 4
Where it fires
- agent 57%
- story 26%
- python 12%
- chat 3%
- worksheet 1%
Makes the model say
m `): sitkmean loudER
Makes it not say
wayOnce numbers story:]`. import game
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 2.76wanted to play their own game.⏎Then, a wise old man saw them quarrel
-
story 2.74pushed and pulled the sunglasses. They were very loud. A big bird saw them fighting and flew
-
story 2.61was too hard.⏎Just then, a nice lady walked by and saw the loud bird and
-
story 2.47in the tree. Tim and his friends felt sad. A kind man saw them and said,
-
chat 2.47he could, but he couldn't reach the balloon. A kind bird saw Tim and wanted to
-
story 2.45said. "But it is so pretty!"⏎Anna's mom looked at the bracelet
-
agent 2.44they were very happy.<|bos|><|system_start|>tools: edit, glob, grep, question,
-
story 2.42much and it made a big mess on the floor.⏎Her mom saw the mess and was
-
story 2.38"Those are our trucks. Go away!"⏎The cat looked at Ben and Sam.
-
agent 2.36always playing and sharing.<|bos|><|system_start|>tools: edit, glob, grep, question,
-
agent 2.36she felt very happy.<|bos|><|system_start|>tools: edit, glob, grep, question,
-
agent 2.35were both very happy.<|bos|><|system_start|>tools: edit, glob, grep, question,