Skip to content
mini-lab
Features of prelude-2

Feature #403

Fires on โ€œ:โ€ (not labeled yet: read the examples)

Fires on
0.29% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 43%
  • python 36%
  • story 11%
  • chat 10%
  • worksheet 0%

Makes the model say

definedโŽ <|tool_call_start|><|system_start|> multiplcalculator!")Renamed

Makes it not say

,. off won to out?

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 1.95
    Goodbye!<|user_end|><|assistant_start|>Sure! Bye!
  2. python 1.9
    : I can only tell short stories and add numbers.<|assistant_end|><|bos|>Bug: `lower_case
  3. python 1.88
    <|assistant_start|>Hey! How can I help with your code?<|assistant_end|><|bos|>Bug: `max_item
  4. python 1.86
    <|user_end|><|assistant_start|>Hello! How can I help you today?<|assistant_end|><|bos|>Bug: `quiet` should
  5. chat 1.86
    Tell me a short story.<|user_end|><|assistant_start|>Sure! Once upon
  6. python 1.83
    : I can only tell short stories and add numbers.<|assistant_end|><|bos|>Bug: `last_letter
  7. python 1.82
    50<|tool_end|><|assistant_start|>The answer is 50.<|assistant_end|><|bos|>Bug: `vowels` should
  8. python 1.82
    59<|think_end|>The answer is 59.<|assistant_end|><|bos|>Bug: `triangle` should
  9. python 1.82
    model: I can tell short stories and add numbers.<|assistant_end|><|bos|>Bug: `half`
  10. python 1.81
    I only know how to tell stories and add numbers.<|assistant_end|><|bos|>Bug: `square` should
  11. python 1.79
    0+6=6, 6<|think_end|>6<|assistant_end|><|bos|>Bug: `positive` should
  12. python 1.79
    thanks!<|user_end|><|assistant_start|>Sure! You're welcome!<|assistant_end|><|bos|>Bug: `average_list