Feature #2452
Fires on “ in” (not labeled yet: read the examples)
- Fires on
- 1.30% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 74%
- chat 15%
- agent 5%
- python 4%
- worksheet 2%
Makes the model say
her hisCan watch( him a([
Makes it not say
<|assistant_end|>$ FalseAnd and!. both
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 3.2the tree.<|bos|>One day, a little boy named Tim was playing in his room. He
-
story 3.12`.⏎<|bos|>One day, a little girl named Lily was playing in her room. She
-
story 3.08now.<|assistant_end|><|bos|>One day, a little girl named Lucy was playing in her room. She
-
story 2.99236.<|bos|>One day, a girl named Lily was playing in her room. She
-
story 2.975.<|assistant_end|><|bos|>One day, a little girl named Amy was playing in her room. She
-
story 2.93today?<|assistant_end|><|bos|>One day, a little girl named Mia was playing in her room. She
-
story 2.92⏎```<|assistant_end|><|bos|>One day, a little dog named Spot was playing in the park. He
-
story 2.862.<|assistant_end|><|bos|>One day, a little girl named Mia was playing in her room. She
-
story 2.84a time, there was a little boy named Tim. Tim was playing in his room when he
-
chat 2.84<|user_end|><|assistant_start|>One day, a little dog named Pup was playing in the park.<|assistant_end|>
-
story 2.83apon.<|bos|>One day, a cat named Bow was walking in the yard. B
-
story 2.79very happy.<|assistant_end|><|bos|>One day, a boy named Tim was playing in his yard. He