Feature #3634
Fires on “ the” (not labeled yet: read the examples)
- Fires on
- 0.38% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 70%
- chat 20%
- agent 9%
- python 1%
- worksheet 0%
Makes the model say
park store st wrong or I g beach
Makes it not say
+ved addsaicommandemo plus counts
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 6.7443.<|assistant_end|><|bos|>One day, a boy named Tim went to the big stadi
-
story 6.71time!<|assistant_end|><|bos|>One day, Tom and his mom went to the store. They saw
-
story 6.54.<|assistant_end|><|bos|>One day, a young boy named Tim went to the store with his mom
-
chat 6.46?<|user_end|><|assistant_start|>One day, a pale boy named Tom went to the park. He
-
story 6.44lab.<|assistant_end|><|bos|>One day, a little boy named Tim went to the park with his mom
-
chat 6.39<|user_end|><|assistant_start|>Sure! One day, a little boy named Tim went to the beach. He saw
-
chat 6.37short story.<|user_end|><|assistant_start|>One day, a boy named Tim went to the park. He
-
story 6.3782.<|bos|>One day, a little girl named Sue went to the park. She saw
-
story 6.373.<|assistant_end|><|bos|>One day, a little girl named Mia went to the kitchen. She wanted
-
chat 6.31tell me a story<|user_end|><|assistant_start|>One day, a brown dog went to the shore. He was
-
chat 6.31<|user_end|><|assistant_start|>Sure! One day, a little boy named Tim went to the beach. He saw
-
story 6.29her danger.<|bos|>One day, a little girl named Amy went to the park. She saw