Skip to content
mini-lab
Features of prelude-2

Feature #3224

Fires on “ upon” (not labeled yet: read the examples)

Fires on
0.65% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 60%
  • chat 29%
  • python 6%
  • agent 4%
  • worksheet 1%

Makes the model say

` courseOnefe alower uponreturn

Makes it not say

not of things toys<|assistant_end|> small lot toy

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 4.35
    7.<|assistant_end|><|bos|><|system_start|>Answer in one short sentence.<|system_end|><|user_start|>Once upon a time...
  2. chat 4.32
    ats.<|assistant_end|><|user_start|>Can you tell me a story?<|user_end|><|assistant_start|>Once upon a time, there
  3. chat 4.32
    .<|assistant_end|><|user_start|>tell me a story about a boat<|user_end|><|assistant_start|>Once upon a time, there
  4. chat 4.3
    .<|system_end|><|user_start|>I want a story about a boat!<|user_end|><|assistant_start|>Once upon a time, there
  5. chat 4.3
    <|user_start|>Can you tell me a story about the sea?<|user_end|><|assistant_start|>Once upon a time, there
  6. chat 4.29
    <|assistant_end|><|bos|><|user_start|>Write a short story about a tree.<|user_end|><|assistant_start|>Once upon a time, there
  7. chat 4.28
    .<|assistant_end|><|user_start|>I want a story about a dragon!<|user_end|><|assistant_start|>Once upon a time, there
  8. chat 4.26
    numbers.<|assistant_end|><|bos|><|user_start|>Tell me a short story.<|user_end|><|assistant_start|>Once upon a time, there
  9. chat 4.25
    about a dragon.<|user_end|><|assistant_start|>Once upon a time, there
  10. chat 4.25
    .<|assistant_end|><|user_start|>I want a story about a cat!<|user_end|><|assistant_start|>Once upon a time, there
  11. chat 4.25
    assistant.<|system_end|><|user_start|>Can you tell me a story?<|user_end|><|assistant_start|>Once upon a time, there
  12. chat 4.25
    .<|assistant_end|><|user_start|>Tell me a story about a dragon.<|user_end|><|assistant_start|>Once upon a time, there