Feature #2028
Fires on “ tree” (not labeled yet: read the examples)
- Fires on
- 2.12% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 72%
- chat 18%
- agent 6%
- python 4%
- worksheet 0%
Makes the model say
in app thatp for. near tree
Makes it not say
ually equalssAddedatsased tears They
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 5.33b⏎```⏎<|bos|>Once upon a time, there was a smelly theater. In the theater
-
chat 4.99a fish.<|user_end|><|assistant_start|>Once upon a time, there was a pretty river.<|assistant_end|><|bos|><|system_start|>
-
story 4.94cake together.<|bos|>Once upon a time, there was an enormous boat. The boat was
-
story 4.91away, he did not see a big rock. Tim fell off
-
story 4.87yummy foods for everyone.<|bos|>One day, a big, powerful bus drove down the street
-
story 4.86Once upon a time, in a small town, there was a tall pole. It was
-
story 4.84upon a time, in a small town, there was a big wet pond. In the pond
-
story 4.81they were happy.<|bos|>Once upon a time, there was an old oyster. The old oyster
-
chat 4.76upon a time, there was an enormous tree. This tree was
-
story 4.75things.⏎One day, Mary's dad brought home a cheap cell phone for Mary
-
story 4.7happy again.<|assistant_end|><|bos|>Once upon a time, there was an old house. In this house
-
chat 4.68a tree.<|user_end|><|assistant_start|>Once upon a time, there was an ancient tree in a big forest