Skip to content
mini-lab
Features of prelude-2

Feature #1799

Fires on “One” (not labeled yet: read the examples)

Fires on
0.55% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 72%
  • chat 24%
  • agent 2%
  • python 2%
  • worksheet 1%

Makes the model say

day afteritems, sunny] timeSo

Makes it not say

sebig biggerest anyonelownven

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 5.78
    <|bos|>One day, a little
  2. story 5.5
    Lucy for making it look so pretty.<|bos|>One day, a little
  3. story 5.49
    things and to be more careful with his toy weapon.<|bos|>One day, a cat
  4. story 5.46
    when she went exploring.<|bos|>One day, a little
  5. story 5.38
    29839 = 74763.<|bos|>One day, a little
  6. chat 5.33
    <|assistant_end|><|bos|><|user_start|>I want a story about a cat!<|user_end|><|assistant_start|>One day, a big
  7. story 5.32
    + 73 = 82.<|bos|>One day, a little
  8. story 5.31
    defined in `items.py`, line 1.<|assistant_end|><|bos|>One sunny day, a
  9. story 5.27
    ⏎So 4 + 89 = 93.<|bos|>One day, a big
  10. chat 5.27
    .<|assistant_end|><|bos|><|user_start|>I want a story about a dog!<|user_end|><|assistant_start|>One day, Dog
  11. story 5.26
    and made a new friend.<|bos|>One day, a bunny
  12. story 5.25
    2 + 475 = 477.<|bos|>One day, a little