Feature #998
Fires on “ big” (not labeled yet: read the examples)
- Fires on
- 0.47% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 56%
- chat 25%
- agent 15%
- worksheet 3%
- python 2%
Makes the model say
blue red tree kn enden letT
Makes it not say
< revernextschema mark]`mean()`.
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 2.87are sorry, big bird. We will leave your eggs here." The big bird was happy,
-
chat 2.75⏎Max saw a big cat and wanted to play with it. The big cat did not want
-
story 2.75ran away, but Chicky was too scared to move. The big dog came closer and
-
story 2.725<|assistant_end|><|bos|>Once upon a time, in a small house near the big tree, a little
-
story 2.68So, Bobo and Kiki did yoga together under the big tree. They had
-
story 2.59no more tea to drink and their house was not tidy anymore. The big, mean monster had
-
story 2.58the ball, laughing and having fun. He played all day under the big rainbow.<|bos|><|system_start|>
-
story 2.54The red bird and the big blue bird sat in
-
story 2.53thought of a plan.⏎Max wagged his tail very fast. The big, scary bird saw
-
story 2.53song to make Tim feel brave.⏎When Tim got down, the big dog was gone.
-
story 2.52to roll down the hill. The small circle went very fast. The big circle was surprised!
-
story 2.51back to their warm, cozy house and promised to never play near the big train again.⏎