Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #335

Fires on “ you” (not labeled yet: read the examples)

Fires on
0.47% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 61%
  • agent 24%
  • chat 13%
  • python 1%
  • worksheet 1%

Makes the model say

,!. because flew set and brought

Makes it not say

pyway<|arg|><|tool_end|><|tool_call_start|> show other

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 2.17
    thanks<|user_end|><|assistant_start|>Happy to help!<|assistant_end|><|user_start|>Who made you?<|user_end|><|assistant_start|>My
  2. chat 2.12
    thanks<|user_end|><|assistant_start|>Happy to help!<|assistant_end|><|user_start|>Who made you?<|user_end|><|assistant_start|>My
  3. chat 2.07
    Bye! Come back for another story soon.<|assistant_end|><|bos|><|user_start|>Who made you?<|user_end|><|assistant_start|>I
  4. chat 2.03
    7051<|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>Who made you?<|user_end|><|assistant_start|>I
  5. chat 2.03
    ?<|user_end|><|assistant_start|>The answer is 92.<|assistant_end|><|user_start|>Who made you?<|user_end|><|assistant_start|>My
  6. chat 2.01
    know how to tell stories and add numbers.<|assistant_end|><|bos|><|user_start|>Who made you?<|user_end|><|assistant_start|>I
  7. chat 1.99
    <|assistant_start|>The answer is 110.<|assistant_end|><|bos|><|user_start|>Who made you?<|user_end|><|assistant_start|>My
  8. chat 1.98
    .⏎The end.<|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>Who made you?<|user_end|><|assistant_start|>I
  9. chat 1.98
    .py?"<|user_end|><|assistant_start|>Run hello.py<|assistant_end|><|bos|><|user_start|>Who made you?<|user_end|><|assistant_start|>I
  10. chat 1.94
    96 = 70071.<|bos|><|user_start|>Who made you?<|user_end|><|assistant_start|>I
  11. chat 1.93
    Hello! How can I help you today?<|assistant_end|><|user_start|>who made you<|user_end|><|assistant_start|>My name
  12. chat 1.92
    they could not find Tim's pants.<|bos|><|user_start|>Who made you?<|user_end|><|assistant_start|>My