Skip to content
mini-lab
Features of prelude-2

Feature #1245

Fires on “ a” (not labeled yet: read the examples)

Fires on
0.43% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 38%
  • chat 38%
  • python 12%
  • agent 12%
  • worksheet 0%

Makes the model say

a an0 big new true tree2

Makes it not say

plusnewString files turns=**/*. waited prints<|tool_start|>

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 4.03
    <|user_start|>Can you tell me a story about a car?<|user_end|><|assistant_start|>
  2. chat 4.02
    me a story about a cat.<|user_end|><|assistant_start|>
  3. chat 3.96
    tell short stories and add numbers.<|assistant_end|><|user_start|>I want a story about a cat!<|user_end|><|assistant_start|>
  4. chat 3.96
    you tell me a story about a fish?<|user_end|><|assistant_start|>
  5. chat 3.94
    <|system_start|>Answer in one short sentence.<|system_end|><|user_start|>I want a story about a boat!<|user_end|><|assistant_start|>
  6. chat 3.92
    to tell stories and add numbers.<|assistant_end|><|user_start|>I want a story about a cat!<|user_end|><|assistant_start|>
  7. chat 3.92
    <|system_start|>Answer in one short sentence.<|system_end|><|user_start|>I want a story about a princess!<|user_end|><|assistant_start|>
  8. chat 3.91
    <|system_start|>Answer in one short sentence.<|system_end|><|user_start|>I want a story about a bunny!<|user_end|><|assistant_start|>
  9. chat 3.88
    <|system_start|>Answer in one short sentence.<|system_end|><|user_start|>I want a story about a dog!<|user_end|><|assistant_start|>
  10. chat 3.85
    was jumping from tree to tree.<|assistant_end|><|user_start|>I want a story about a princess!<|user_end|><|assistant_start|>
  11. chat 3.83
    short stories and add numbers.<|assistant_end|><|user_start|>tell me a story about a boat<|user_end|><|assistant_start|>Once
  12. story 3.82
    , he couldn't believe what he read. It was a story about a special celebration