Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #206

Fires on “ upon” (not labeled yet: read the examples)

Fires on
0.50% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 43%
  • python 24%
  • chat 19%
  • agent 15%
  • worksheet 0%

Makes the model say

but liked tooBut mainOnce opencodehing

Makes it not say

hugged again<|assistant_end|> With gift had late shared

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 3.42
    .<|assistant_end|><|user_start|>tell me a story about a boat<|user_end|><|assistant_start|>Once upon a time, there
  2. chat 3.36
    .<|assistant_end|><|user_start|>Tell me a story about a dragon.<|user_end|><|assistant_start|>Once upon a time, there
  3. chat 3.34
    <|assistant_end|><|bos|><|user_start|>Write a short story about a tree.<|user_end|><|assistant_start|>Once upon a time, there
  4. chat 3.32
    <|assistant_end|><|bos|><|user_start|>Write a short story about the sea.<|user_end|><|assistant_start|>Once upon a time, there
  5. chat 3.28
    numbers.<|assistant_end|><|bos|><|user_start|>Tell me a short story.<|user_end|><|assistant_start|>Once upon a time, there
  6. chat 3.28
    .<|system_end|><|user_start|>I want a story about a boat!<|user_end|><|assistant_start|>Once upon a time, there
  7. chat 3.27
    .<|system_end|><|user_start|>Write a short story about the sea.<|user_end|><|assistant_start|>Once upon a time, in
  8. chat 3.26
    <|user_start|>Can you tell me a story about the sea?<|user_end|><|assistant_start|>Once upon a time, there
  9. chat 3.26
    .<|assistant_end|><|user_start|>I want a story about a dragon!<|user_end|><|assistant_start|>Once upon a time, there
  10. chat 3.25
    <|assistant_end|><|bos|><|user_start|>Tell me a story about a fish.<|user_end|><|assistant_start|>Once upon a time, there
  11. chat 3.25
    .<|system_end|><|user_start|>I want a story about a tree!<|user_end|><|assistant_start|>Once upon a time, there
  12. chat 3.24
    .<|assistant_end|><|user_start|>I want a story about a princess!<|user_end|><|assistant_start|>Once upon a time, there