Feature #3800
Fires on “ night” (not labeled yet: read the examples)
- Fires on
- 0.49% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 61%
- agent 14%
- chat 12%
- python 10%
- worksheet 4%
Makes the model say
room kitchen))ink doorfortable day Everyone
Makes it not say
ould windpythonananan divisibleving maybe
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 2.237<|tool_end|><|assistant_start|>The answer is 87.<|assistant_end|><|bos|><|user_start|>Good night!<|user_end|><|assistant_start|>Bye
-
chat 2.2. They played together for the rest of the day.<|bos|><|user_start|>Good night!<|user_end|><|assistant_start|>Bye
-
chat 2.19. He forgave Lily. He loved her too.<|bos|><|user_start|>Good night!<|user_end|><|assistant_start|>Good
-
chat 2.13sure her actions always had gentle results.<|bos|><|user_start|>Good night!<|user_end|><|assistant_start|>Good
-
chat 2.07outside. He saw a ball near the grass.<|assistant_end|><|user_start|>Good night!<|user_end|><|assistant_start|>Good
-
story 2.07the messy house. She said, "Lucy, you made a big mess. Now you have
-
chat 2.064<|tool_end|><|assistant_start|>The answer is 84.<|assistant_end|><|bos|><|user_start|>Good night!<|user_end|><|assistant_start|>Bye
-
chat 2.03=<|user_end|><|assistant_start|>The answer is 158.<|assistant_end|><|user_start|>Good night!<|user_end|><|assistant_start|>Bye
-
chat 2.02model: I can tell short stories and add numbers.<|assistant_end|><|user_start|>Good night!<|user_end|><|assistant_start|>Good
-
chat 2.0=<|user_end|><|assistant_start|>The answer is 158.<|assistant_end|><|user_start|>Good night!<|user_end|><|assistant_start|>Bye
-
chat 2.079 and 19 is 98.<|bos|><|user_start|>Good night!<|user_end|><|assistant_start|>Bye
-
chat 1.99bird became good friends.<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>Good night!<|user_end|><|assistant_start|>Good