Skip to content
mini-lab
Features of prelude-2

Feature #2715

Fires on “ some” (not labeled yet: read the examples)

Fires on
0.29% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 83%
  • story 8%
  • chat 6%
  • worksheet 2%
  • python 1%

Makes the model say

But but seen when makesches course see

Makes it not say

all Python)` named ` both big<|assistant_end|>

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 2.36
    !<|user_end|><|assistant_start|>Hi there! Would you like a story, or some numbers to add?
  2. chat 2.34
    there<|user_end|><|assistant_start|>Hi there! Would you like a story, or some numbers to add?
  3. chat 2.3
    there<|user_end|><|assistant_start|>Hi there! Would you like a story, or some numbers to add?
  4. story 2.27
    Lily loved to dance. She danced in her room, in the garden, and in the park
  5. chat 2.26
    !<|user_end|><|assistant_start|>Hi there! Would you like a story, or some numbers to add?
  6. chat 2.25
    Hi<|user_end|><|assistant_start|>Hi there! Would you like a story, or some numbers to add?
  7. chat 2.24
    Hello<|user_end|><|assistant_start|>Hi there! Would you like a story, or some numbers to add?
  8. story 2.16
    . They made a picture of a house, a tree, a dog, and a sun.
  9. chat 2.15
    !<|user_end|><|assistant_start|>Hi there! Would you like a story, or some numbers to add?
  10. chat 2.14
    !<|user_end|><|assistant_start|>Hi there! Would you like a story, or some numbers to add?
  11. chat 2.13
    Hey<|user_end|><|assistant_start|>Hi there! Would you like a story, or some numbers to add?
  12. chat 2.1
    i<|user_end|><|assistant_start|>Hi there! Would you like a story, or some numbers to add?