Feature #3372
Fires on “ friends” (not labeled yet: read the examples)
- Fires on
- 0.98% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 70%
- chat 16%
- agent 13%
- worksheet 1%
- python 1%
Makes the model say
who,. and whats again then
Makes it not say
schema<|assistant_end|> "$aeiourunByeopencoderied
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 7.367 = 91540<|bos|>Tom and Mia were best friends. They lived next
-
story 7.29a time, there was a girl called Amy. She was a happy girl who liked to play
-
story 7.04to tell stories and add numbers.<|assistant_end|><|bos|>Anna and Lily were best friends. They liked to
-
story 6.94tell short stories and add numbers.<|assistant_end|><|bos|>Lila and Sam were best friends. They liked to
-
story 6.77=6, 6<|think_end|>6<|assistant_end|><|bos|>Lily and Tom were best friends. They liked to
-
story 6.76forest, there was a little girl named Lucy. Lucy was a dependable girl who always kept her
-
story 6.64they had many fun adventures together.<|assistant_end|><|bos|>Ben and Sam were best friends. They liked to
-
story 6.5to tell stories and add numbers.<|assistant_end|><|bos|>Lily and Ben were best friends. They liked to
-
story 6.49a time, there was a boy named Tim. Tim was a happy boy who loved to smile
-
story 6.43of x, rounded down.<|assistant_end|><|bos|>Ben and Lily were best friends. They liked to
-
story 6.41a time, there was a girl named Lily. Lily was a bossy girl. She liked to
-
story 6.29named Bob wanted to fly high in the sky. Bob was a happy bird who lived in a