Skip to content
mini-lab
Features of prelude-2

Feature #1891

Fires on “Once” (not labeled yet: read the examples)

Fires on
0.40% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 46%
  • chat 30%
  • agent 22%
  • worksheet 2%
  • python 0%

Makes the model say

idea agreed example together toould ""

Makes it not say

iB sky little moral other new fell

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 3.8
    7.<|assistant_end|><|user_start|>I want a story about a dragon!<|user_end|><|assistant_start|>Once upon a time,
  2. chat 3.75
    <|assistant_end|><|user_start|>can you tell me a story about a dragon<|user_end|><|assistant_start|>Once upon a time,
  3. chat 3.71
    sentence.<|system_end|><|user_start|>I want a story about the sea!<|user_end|><|assistant_start|>Once upon a time,
  4. chat 3.69
    sentence.<|system_end|><|user_start|>I want a story about the sea!<|user_end|><|assistant_start|>Once upon a time,
  5. chat 3.67
    sentence.<|system_end|><|user_start|>I want a story about a boat!<|user_end|><|assistant_start|>Once upon a time,
  6. chat 3.67
    tree.<|assistant_end|><|user_start|>I want a story about a princess!<|user_end|><|assistant_start|>Once upon a time,
  7. chat 3.66
    helpful assistant.<|system_end|><|user_start|>Can you tell me a story?<|user_end|><|assistant_start|>Once upon a time,
  8. chat 3.65
    13.<|assistant_end|><|user_start|>i want a story about a dog<|user_end|><|assistant_start|>Once upon a time,
  9. chat 3.64
    sentence.<|system_end|><|user_start|>I want a story about a tree!<|user_end|><|assistant_start|>Once upon a time,
  10. chat 3.63
    <|assistant_end|><|user_start|>can you tell me a story about a dragon<|user_end|><|assistant_start|>Once upon a time,
  11. chat 3.63
    short sentence.<|system_end|><|user_start|>Can you tell me a story?<|user_end|><|assistant_start|>Once upon a time,
  12. chat 3.63
    exclaim(s)`.<|assistant_end|><|bos|><|user_start|>I want a story!<|user_end|><|assistant_start|>Once upon a time,