Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #1438

Fires on “ to” (not labeled yet: read the examples)

Fires on
0.28% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 60%
  • agent 18%
  • story 14%
  • worksheet 8%
  • python 0%

Makes the model say

Sureiceared sunter herselfselfOnce

Makes it not say

the."!!" something)` Tim this

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 2.98
    <|system_end|><|user_start|>Thank you<|user_end|><|assistant_start|>You're welcome!<|assistant_end|><|user_start|>I need to know 97
  2. chat 2.94
    etween their hands. They laughed and laughed.⏎"That was fun!" Joe
  3. chat 2.87
    llo! How can I help you today?<|assistant_end|><|bos|><|user_start|>I need to know 67
  4. chat 2.8
    <|think_end|>The answer is 189.<|assistant_end|><|bos|><|user_start|>I need to know 8 +
  5. chat 2.76
    laughed and laughed.⏎"That was fun!" Joe
  6. chat 2.75
    <|user_end|><|assistant_start|>The answer is 963.<|assistant_end|><|user_start|>I need to know 61
  7. chat 2.75
    8<|think_end|>The answer is 78.<|assistant_end|><|bos|><|user_start|>I need to know 38
  8. chat 2.72
    79 equals 54218.<|bos|><|user_start|>I need to know 73
  9. chat 2.72
    887 = 1507.<|bos|><|user_start|>I need to know 89
  10. chat 2.7
    4<|think_end|>The answer is 94.<|assistant_end|><|bos|><|user_start|>I need to know 55
  11. chat 2.69
    You are mini, a small and friendly assistant.<|system_end|><|user_start|>I need to know 0 +
  12. chat 2.68
    very yummy, and they had a fun day.<|bos|><|user_start|>I need to know 41