Feature #3524
Fires on “ beach” (not labeled yet: read the examples)
- Fires on
- 1.21% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 79%
- chat 14%
- agent 5%
- python 1%
- worksheet 0%
Makes the model say
where more count with many all together.
Makes it not say
upon touched youendYouNameError<|think_start|>he
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 6.22every number of nums doubled.<|assistant_end|><|bos|>Tom and Lily went to the beach with their mom and
-
story 6.143)` returns `8`.⏎<|bos|>Anna and Ben went to the beach with Mom and Dad
-
story 5.58contains<|assistant_end|><|bos|>One day, a little boy named Tim went to the beach with his family.
-
chat 5.57<|assistant_start|>Sure! One day, a little boy named Tim went to the beach. He saw a
-
story 5.4949.<|bos|>One day, a boy named Tim went to the beach with his mom and
-
story 5.47returns a greeting for name.<|assistant_end|><|bos|>Sara and Ben went to the beach with Mom and Dad
-
chat 5.37<|assistant_start|>Sure! One day, a little boy named Tim went to the beach. He saw a
-
story 5.32and songs she makes up.⏎One day, Anna goes to the park with her mom.
-
chat 5.29day, a little boy named Tim went to a party. At the party, there was a
-
story 5.28One day, a boy named Tim went to the big stadium with his dad.
-
story 5.25.<|assistant_end|><|bos|>One day, a young boy named Tim went to the store with his mom.
-
story 5.24colors and playing together.<|bos|>Once upon a time, in a big forest, there was a