Feature #2684
Fires on “ day” (not labeled yet: read the examples)
- Fires on
- 1.24% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 82%
- chat 13%
- agent 2%
- worksheet 2%
- python 1%
Makes the model say
., and long but!." in
Makes it not say
Fixednew<|system_end|> generator_*.`: defines recent
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 7.51a restless boy named Tim. He loved to run and play all day. Tim had a
-
chat 7.45a foolish dog named Max. Max loved to run and play all day.<|assistant_end|><|user_start|>Who
-
story 7.37very enthusiastic. He loved to play and run all day. One day,
-
chat 7.33a foolish dog named Max. Max loved to run and play all day.<|assistant_end|><|user_start|>Who
-
story 7.32playful cat named Mimi. Mimi loved to play with her ball all day long. She would
-
story 7.26was a clumsy dog named Spot. Spot loved to play and run all day long. He had
-
story 7.24outside with his friends. They would run, jump, and laugh all day long. Tim was
-
story 7.23was a pink bunny named Lily. She loved to hop and play all day with her friends.
-
chat 7.21a foolish dog named Max. Max loved to run and play all day.<|assistant_end|><|user_start|>Who
-
story 7.18was a little rabbit named Remy. Remy loved to jump and play all day. One sunny day
-
story 7.14friends who liked to play with her. They would run and laugh all day long.⏎One
-
story 7.03was very enthusiastic and liked to jump and play all day.⏎One day