Feature #1113
Fires on “ was” (not labeled yet: read the examples)
- Fires on
- 0.38% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 67%
- chat 29%
- agent 4%
- python 1%
- worksheet 0%
Makes the model say
Her?"g?Bug= a long
Makes it not say
edlistmyhepathou<|assistant_end|>ful
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 4.78opened the box together, the surprise was not broken.<|bos|>Once there was a man who was
-
chat 4.66<|assistant_end|><|user_start|>Write a short story about a fish.<|user_end|><|assistant_start|>Once there was a dolphin who lived
-
chat 4.62<|system_end|><|user_start|>I want a story about a cake!<|user_end|><|assistant_start|>Once there was a big, at
-
chat 4.57calculator<|system_end|><|user_start|>Tell me a short story.<|user_end|><|assistant_start|>Once, there was a very cute and
-
story 4.5690 = 109198.<|bos|>Once there was a little boy named
-
story 4.56They were so happy that they had not been scared.<|bos|>Once there was a poor boy named
-
story 4.52be friends and make the world a beautiful place.<|bos|>Once, there was a little boy named
-
chat 4.51worried anymore."<|bos|><|user_start|>I want a story!<|user_end|><|assistant_start|>Once there was a kind man.
-
story 4.5and 68 is 9448.<|bos|>Once there was a tree. It
-
story 4.5Python files in this project.<|assistant_end|><|bos|>Once upon a time, there was a nosy bee named
-
story 4.5little boy and a big fish surfing together.<|bos|>Once, there was a boy named Tim
-
chat 4.49short story.<|user_end|><|assistant_start|>Sure! Once upon a time, there was a unique bird.