Feature #2461
Fires on “.” (not labeled yet: read the examples)
- Fires on
- 2.24% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 79%
- chat 11%
- agent 7%
- python 3%
- worksheet 1%
Makes the model say
<|bos|> seenThe happily story no never lived
Makes it not say
Hello % right fasterries agance
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 7.3anymore. She liked the
-
story 7.18it to play with her friend again. And they lived happily ever after.<|bos|>Once upon a
-
story 6.74again.<|bos|><|system_start|>tools
-
story 6.65They laughed and played together every day. And they lived happily ever after.<|bos|><|system_start|>Start every
-
story 6.62and never let anything get lost again. And they lived happily ever after.<|bos|>Once upon a
-
story 6.47and shared them with their friends. And they all lived happily ever after.<|bos|><|user_start|>Tell me
-
chat 6.44great sailor and a good friend. And they all lived happily ever after.<|assistant_end|><|bos|><|system_start|>Answer
-
story 6.16she could have with her toys. And they all lived happily ever after.<|bos|><|system_start|>tools:
-
story 6.15her mom would always help her. And they all lived happily ever after.<|bos|><|system_start|>Answer with
-
story 6.11red balls when they were hungry. And they all lived happily ever after.<|bos|><|system_start|>tools:
-
story 6.11played together and became best friends. And they all lived happily ever after.<|bos|><|system_start|>tools:
-
story 5.93safe and shiny on the tree. And they all lived happily ever after.<|bos|>How much is