Feature #3097
Fires on “ tell” (not labeled yet: read the examples)
- Fires on
- 0.32% of tokens
- Mostly in
- chat
- Layer
- after block 4
Where it fires
- chat 58%
- story 27%
- python 8%
- agent 6%
- worksheet 1%
Makes the model say
list⏎ TellourWrite range* test
Makes it not say
was is,.'s in⏎ from
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 3.88<|user_start|>What can you do?<|user_end|><|assistant_start|>I'm prelude: I can tell you short stories for
-
chat 3.86How can you help me?<|user_end|><|assistant_start|>I'm prelude: I can tell you short stories for
-
chat 3.79<|user_start|>What can you do?<|user_end|><|assistant_start|>I'm prelude: I can tell you short stories for
-
chat 3.76<|user_start|>What can you do?<|user_end|><|assistant_start|>I'm prelude: I can tell you short stories for
-
chat 3.74<|user_start|>What can you do?<|user_end|><|assistant_start|>I'm prelude: I can tell you short stories for
-
chat 3.7How can you help me?<|user_end|><|assistant_start|>I'm prelude: I can tell you short stories for
-
chat 3.67How can you help me?<|user_end|><|assistant_start|>I'm prelude: I can tell you short stories for
-
chat 3.67<|user_start|>What can you do?<|user_end|><|assistant_start|>I'm prelude: I can tell you short stories for
-
chat 3.66How can you help me?<|user_end|><|assistant_start|>I'm prelude: I can tell you short stories for
-
chat 3.65<|user_start|>how can you help me<|user_end|><|assistant_start|>I'm prelude: I can tell you short stories for
-
chat 3.64How can you help me?<|user_end|><|assistant_start|>I'm prelude: I can tell you short stories for
-
chat 3.61<|user_start|>What can you do?<|user_end|><|assistant_start|>I'm prelude: I can tell you short stories for