Feature #1553
Fires on “ was” (not labeled yet: read the examples)
- Fires on
- 1.47% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 68%
- agent 15%
- chat 13%
- worksheet 2%
- python 2%
Makes the model say
playing very outside at to out idea in
Makes it not say
end branches adder are multipl smiledred
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 4.918745.<|bos|>One day, a little boy named Timmy was curious about what was
-
story 4.82, 3)⏎1⏎<|bos|>One day, a little monkey was playing in the trees
-
story 4.79step or with a calculator.<|assistant_end|><|bos|>One day, a sweet cat was walking in the park
-
story 4.7toy weapon.<|bos|>One day, a cat named Bow was walking in the yard
-
story 4.7" " + b⏎```⏎<|bos|>One day, a little ant was walking in the park
-
story 4.68`app.py`.<|assistant_end|><|bos|>One day, a little red bird was flying in the sky
-
story 4.68638.<|assistant_end|><|bos|>One day, a boy named Tom was very eager to dis
-
chat 4.62One day, Ben was playing with his best
-
story 4.5710236.<|bos|>One day, a girl named Lily was playing in her room
-
story 4.57⏎5.5⏎<|bos|>One day, a little dog named Max was very bored. He
-
story 4.56is 8.<|assistant_end|><|bos|>One day, a little girl named Lily was playing with her toy
-
story 4.55: `run.py`.<|assistant_end|><|bos|>One day, a small bird was flying in the sky