Skip to content
mini-lab
Features of prelude-2

Feature #1682

Fires on “ made” (not labeled yet: read the examples)

Fires on
0.44% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 55%
  • chat 22%
  • story 16%
  • python 6%
  • worksheet 0%

Makes the model say

There today toys3 left next b made

Makes it not say

]`⏎`def=**/*. Pythonhinglistlib

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 2.04
    <|user_start|>thanks<|user_end|><|assistant_start|>Happy to help!<|assistant_end|><|user_start|>Who made you?<|user_end|><|assistant_start|>
  2. chat 2.0
    <|user_start|>thanks<|user_end|><|assistant_start|>Happy to help!<|assistant_end|><|user_start|>Who made you?<|user_end|><|assistant_start|>
  3. story 1.99
    cake from the back of the
  4. chat 1.98
    ⏎<|bos|><|user_start|>Thank you<|user_end|><|assistant_start|>You're welcome!<|assistant_end|><|user_start|>Who made you?<|user_end|><|assistant_start|>
  5. chat 1.89
    Bye<|user_end|><|assistant_start|>Goodbye! Have a nice day.<|assistant_end|><|user_start|>Who are you?<|user_end|>
  6. agent 1.86
    is not his!<|bos|><|system_start|>You are a title generator.<|system_end|><|user_start|>Run main.py.
  7. chat 1.85
    hello.py?"<|user_end|><|assistant_start|>Run hello.py<|assistant_end|><|bos|><|user_start|>Who made you?<|user_end|><|assistant_start|>
  8. chat 1.79
    <|assistant_start|>Bye! Come back for another story soon.<|assistant_end|><|bos|><|user_start|>Who made you?<|user_end|><|assistant_start|>
  9. agent 1.78
    (items)`.<|assistant_end|><|bos|><|system_start|>You are a title generator.<|system_end|><|user_start|>Run the test suite
  10. chat 1.77
    <|tool_end|><|assistant_start|>The answer is 110.<|assistant_end|><|bos|><|user_start|>Who made you?<|user_end|><|assistant_start|>
  11. chat 1.76
    good friends. They played with the triangle every day.<|assistant_end|><|bos|><|user_start|>Who won the last W
  12. chat 1.73
    78.<|assistant_end|><|user_start|>Who are you?<|user_end|>