Skip to content
mini-lab
Features of prelude-2

Feature #384

Fires on “Once” (not labeled yet: read the examples)

Fires on
0.20% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 70%
  • chat 29%
  • agent 0%
  • python 0%
  • worksheet 0%

Makes the model say

uponOnce example be⏎ ⏎ <|tool_end|> moral

Makes it not say

hardsO theirn its last our

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 5.42
    14.<|bos|><|user_start|>Tell me a short story.<|user_end|><|assistant_start|>Once upon a time,
  2. chat 5.41
    cubed<|assistant_end|><|bos|><|user_start|>Write a short story about a tree.<|user_end|><|assistant_start|>Once upon a time,
  3. story 5.35
    665<|think_end|>The answer is 665.<|assistant_end|><|bos|>Once upon a time,
  4. chat 5.33
    short sentence.<|system_end|><|user_start|>Can you tell me a story?<|user_end|><|assistant_start|>Once upon a time,
  5. chat 5.33
    438<|bos|><|user_start|>Can you tell me a story?<|user_end|><|assistant_start|>Once upon a time,
  6. chat 5.3
    <|system_end|><|user_start|>Can you tell me a story about a tree?<|user_end|><|assistant_start|>Once upon a time,
  7. chat 5.3
    helpful assistant.<|system_end|><|user_start|>Can you tell me a story?<|user_end|><|assistant_start|>Once upon a time,
  8. chat 5.3
    small and friendly assistant.<|system_end|><|user_start|>I want a story!<|user_end|><|assistant_start|>Once upon a time,
  9. chat 5.28
    .<|assistant_end|><|bos|><|user_start|>Tell me a story about a cat.<|user_end|><|assistant_start|>Once upon a time,
  10. chat 5.28
    <|assistant_end|><|user_start|>can you tell me a story about a dog<|user_end|><|assistant_start|>Once upon a time,
  11. chat 5.28
    sentence.<|system_end|><|user_start|>I want a story about the sea!<|user_end|><|assistant_start|>Once upon a time,
  12. chat 5.27
    sentence.<|system_end|><|user_start|>Tell me a story about a ball.<|user_end|><|assistant_start|>Once upon a time,