Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #3581

Fires on “ upon” (not labeled yet: read the examples)

Fires on
0.82% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 56%
  • story 25%
  • chat 14%
  • worksheet 3%
  • python 2%

Makes the model say

likeate lovey nameest slide hugs

Makes it not say

saidexpression requ<|think_end|>assert asked there<|tool_call_end|>

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 3.12
    warmth. Just like warm, soft wool.<|bos|><|user_start|>Once upon a time...
  2. story 3.07
    not quarrel anymore, and they were happy.<|bos|>Once upon a time, there
  3. story 3.05
    ```<|assistant_end|><|bos|>Once upon a time, there
  4. story 3.03
    I only know how to tell stories and add numbers.<|assistant_end|><|bos|>Once upon a time, a
  5. story 3.03
    and add numbers.<|assistant_end|><|bos|>Once upon a time, there
  6. story 3.01
    <|bos|>Once upon a time, there
  7. story 3.01
    <|bos|>Once upon a time, there
  8. story 3.01
    <|bos|>Once upon a time, there
  9. story 3.01
    <|bos|>Once upon a time, there
  10. story 3.01
    <|bos|>Once upon a time, in
  11. story 3.01
    <|bos|>Once upon a time, there
  12. story 3.0
    , edit and fix the Python files in this project.<|assistant_end|><|bos|>Once upon a time, there