Feature #3525
Fires on “ named” (not labeled yet: read the examples)
- Fires on
- 0.15% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 65%
- chat 16%
- agent 12%
- python 6%
- worksheet 2%
Makes the model say
includes noweven Mia around(- = same
Makes it not say
"`ter help promise<|arg|> sure hopping
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 1.82a story?<|user_end|><|assistant_start|>Once upon a time, there was a girl named Lily. She
-
chat 1.75a story?<|user_end|><|assistant_start|>Once upon a time, there was a girl named Lily. She
-
chat 1.75<|assistant_start|>Once upon a time, a little girl named Lucy went to the
-
chat 1.74<|assistant_start|>Sure! Once upon a time, there was a young girl named Lily. She had
-
chat 1.73?<|user_end|><|assistant_start|>Once upon a time, there was a girl named Lily. She
-
story 1.73<|bos|>Once upon a time, there was a little girl named Sue. She loved
-
chat 1.72cake?<|user_end|><|assistant_start|>Once upon a time, there was a little girl named Lily. She
-
story 1.72<|bos|>Once upon a time, there was a girl named Lucy. She had
-
story 1.71⏎```<|assistant_end|><|bos|>Once upon a time, there was a little girl named Mary. M
-
story 1.705<|assistant_end|><|bos|>Once upon a time, there was a little girl named Lily. She loved
-
chat 1.69story.<|user_end|><|assistant_start|>Once upon a time, there was a little boy named Tim. Tim
-
story 1.68<|think_end|>39<|assistant_end|><|bos|>Once upon a time, there was a girl named Lily. She had