Feature #2713
Fires on “ are” (not labeled yet: read the examples)
- Fires on
- 0.57% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 68%
- chat 18%
- agent 12%
- python 2%
- worksheet 0%
Makes the model say
friends TodayHello became differentve TheyTrue
Makes it not say
The "." that ' but shout
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 7.62in `main.py`.<|assistant_end|><|bos|>Lily and Ben are playing in the park
-
story 7.378<|think_end|>The answer is 78.<|assistant_end|><|bos|>Tom and Sam are friends. They like
-
story 7.34, 790<|think_end|>790<|assistant_end|><|bos|>Lily and Ben are friends. They like
-
story 7.2437 = 91540<|bos|>Tom and Mia were best friends. They
-
story 7.1a story, or some numbers to add?<|assistant_end|><|bos|>Sara and Tom are friends. They like
-
story 7.06I can tell short stories and add numbers.<|assistant_end|><|bos|>Tom and Mia were playing in the park
-
story 7.02items)`. The tests pass now.<|assistant_end|><|bos|>Lily and Ben are playing with blocks.
-
story 6.9numbers. Try asking me for a story!<|assistant_end|><|bos|>Tom and Mia are at the beach with
-
story 6.89. The big cactus was now their new friend.<|bos|>Sara and Ben are twins. They like
-
story 6.77<|tool_end|><|assistant_start|>Created `greeting.py`.<|assistant_end|><|bos|>Sam and Ben are brothers. They
-
story 6.76can only tell short stories and add numbers.<|assistant_end|><|bos|>Lily and Ben were playing knights
-
story 6.72can only tell short stories and add numbers.<|assistant_end|><|bos|>Tom and Sam were friends. They liked