Feature #1064
Fires on “ talk” (not labeled yet: read the examples)
- Fires on
- 1.23% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 69%
- chat 14%
- worksheet 6%
- python 6%
- agent 4%
Makes the model say
kids all about just only repeatAnswer All
Makes it not say
." makes):Later when`? idea
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 2.89started to talk! The tree said
-
story 2.51the big, red book, something unexpected happened. The book started to talk! The girl and
-
story 2.46picked up the toy, something unexpected happened. The toy started to talk! The toy said,
-
story 2.4. It could talk! The vine
-
chat 2.36me?"⏎Then, something unexpected happened. The crab started to talk! The crab said,
-
story 2.3cat.<|bos|>Once upon a time, there was a big store. In the store, there
-
story 2.29. I want to be the best swimmer in the sea." Fin thought for a moment and
-
story 2.21fun! Then, something unexpected happened. The balls started to move and talk! They were not
-
story 2.12. It looked so big and funny! Suddenly, the bug started to talk. Mia was very
-
story 2.1makes me feel good. Do you want to try?"⏎Bobo thought about it and said
-
story 2.0572<|assistant_end|><|bos|>Once upon a time, there was a store. In the store, there
-
story 2.05the hay. There is enough for all of us." The bird thought about it and agreed