Feature #538
Fires on “ who” (not labeled yet: read the examples)
- Fires on
- 0.40% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 76%
- chat 14%
- agent 9%
- python 1%
- worksheet 0%
Makes the model say
lived loved liked worked knew[-se wanted
Makes it not say
. down for,"rt Then on
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 7.53to make the wheel feel better.⏎They went to a kind man who knew how to fix
-
chat 7.08to make the wheel feel better.⏎They went to a kind man who knew how to fix
-
story 6.86each other.<|bos|>Once upon a time, there was an elderly man who loved to surf.
-
story 6.75not scared of the water anymore.<|assistant_end|><|bos|>Lila was a tall girl who liked to play outside
-
story 6.64together, the surprise was not broken.<|bos|>Once there was a man who was fishing by
-
story 6.62nums)`.<|assistant_end|><|bos|>Once upon a time there was a dependable little girl who was turning three
-
story 6.61. Sue was a wise lady who knew all about the
-
story 6.57an was not able to pick it up.⏎A wise old man who was sitting nearby saw
-
story 6.569.<|assistant_end|><|bos|>Once upon a time, there was a kind man who had a print shop
-
story 6.5the picture all day.<|bos|>Once upon a time there was a man who wanted to do something
-
story 6.31about the universe. One day, Mia met a kind old man who knew many things about
-
story 6.28up was playing in the park.<|assistant_end|><|bos|>Molly was a little girl who loved to run.