Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #4003

Fires on “ upon” (not labeled yet: read the examples)

Fires on
0.43% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 42%
  • chat 24%
  • python 17%
  • worksheet 9%
  • agent 8%

Makes the model say

fionEert_=o by

Makes it not say

becausedoubled excited r having fell happy working

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 3.11
    0.<|assistant_end|><|bos|>Once upon a time, there
  2. chat 3.07
    warmth. Just like warm, soft wool.<|bos|><|user_start|>Once upon a time...
  3. story 3.06
    .<|assistant_end|><|bos|>Once upon a time there were
  4. story 3.06
    .<|assistant_end|><|bos|>Once upon a time, there
  5. story 3.03
    ing colors and playing together.<|bos|>Once upon a time, in
  6. story 3.0
    , edit and fix the Python files in this project.<|assistant_end|><|bos|>Once upon a time, there
  7. story 2.99
    ```<|assistant_end|><|bos|>Once upon a time, there
  8. story 2.99
    Python files in this project.<|assistant_end|><|bos|>Once upon a time, there
  9. chat 2.99
    edit and fix the Python files in this project.<|assistant_end|><|bos|><|user_start|>Once upon a time...
  10. story 2.97
    Sam was a little boy.<|assistant_end|><|bos|>Once upon a time, there
  11. story 2.96
    <|assistant_end|><|bos|>Once upon a time, there
  12. story 2.96
    is 70.<|assistant_end|><|bos|>Once upon a time, there