Feature #3854
Fires on “p” (not labeled yet: read the examples)
- Fires on
- 2.99% of tokens
- Mostly in
- agent
- Layer
- after block 4
Where it fires
- agent 82%
- story 14%
- chat 2%
- python 2%
- worksheet 1%
Makes the model say
newetyerseder ourort
Makes it not say
Oncenitude kids( "$One She Tim
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 3.56She wanted to climb the tree and see the world from a different perspective. The
-
story 3.31your instincts, you can often find unexpected wonders.<|bos|><|system_start|>
-
story 3.17heard about the girl's strong desire to help and had been expecting her to
-
story 3.08story is to always listen to your friends and never take candy from strangers.<|bos|><|system_start|>
-
story 3.06the window. From then on, Jack knew that he could always support his family in
-
story 3.06Lily asked her mom. Her mom smiled and said, "Puppies grow into dogs
-
story 2.99to sleep. From that day on, Sally was never scared of monsters again.<|bos|>
-
agent 2.93pass now.<|assistant_end|><|bos|><|system_start|>tools: edit, glob, grep, question, read
-
agent 2.92the magic camera.<|bos|><|system_start|>tools: edit, glob, grep, question, read
-
agent 2.86play with.<|assistant_end|><|bos|><|system_start|>tools: edit, glob, grep, question, read
-
agent 2.85very own garden!<|bos|><|system_start|>tools: edit, glob, grep, question, read
-
agent 2.84pass now.<|assistant_end|><|bos|><|system_start|>tools: edit, glob, grep, question, read