Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #1980

Fires on “Once” (not labeled yet: read the examples)

Fires on
1.20% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 81%
  • chat 13%
  • python 2%
  • worksheet 2%
  • agent 2%

Makes the model say

dayge Python on* thereake project

Makes it not say

5 result!oo it so x0

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 7.23
    <|bos|>Once upon a time,
  2. story 7.23
    <|bos|>Once upon a time,
  3. story 7.23
    <|bos|>Once upon a time,
  4. story 7.23
    <|bos|>Once upon a time,
  5. story 7.23
    <|bos|>Once upon a time,
  6. story 7.23
    <|bos|>Once upon a time,
  7. story 7.16
    py`.<|assistant_end|><|bos|>Once upon a time,
  8. story 6.92
    ```<|assistant_end|><|bos|>Once upon a time,
  9. story 6.8
    1382<|bos|>Once upon a time,
  10. story 6.68
    61799.<|bos|>Once upon a time,
  11. story 6.68
    hi.py`.<|assistant_end|><|bos|>Once upon a time,
  12. story 6.67
    with `final_letter(s)`.<|assistant_end|><|bos|>Once upon a time,