Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #1287

Fires on “ of” (not labeled yet: read the examples)

Fires on
0.44% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 41%
  • agent 24%
  • python 24%
  • chat 7%
  • worksheet 4%

Makes the model say

ayone Sueet of be Li

Makes it not say

Try<|bos|>:`.<|user_end|>Ofhttps counts")`

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 2.98
    's alright, Max. Maybe it will come back someday."⏎Max
  2. story 2.14
    and play. One day, they decided to have a big holiday.⏎On
  3. story 2.1
    someday.⏎They
  4. story 2.04
    . Once she was settled, she pulled out a piece of paper from her pocket
  5. story 1.98
    to write with it. So, she took the pen and a piece of paper. Lily started
  6. chat 1.95
    <|assistant_start|>One day, a little fish named Tim saw a big octopus.<|assistant_end|><|bos|>
  7. story 1.95
    the trees and houses.⏎One day, Bobo found a big piece of gum on the ground
  8. story 1.89
    ! That's a good idea."⏎Ruby took a piece of meat from her lunch
  9. story 1.87
    They saw a big tree with lots of leaves. Tim saw a piece of stick on the ground
  10. story 1.86
    the bottom of the slide, there was a terrible surprise! A piece of sticky tape was
  11. story 1.86
    the skeleton away and
  12. story 1.83
    , while playing near the woods, he found a big, tough piece of wood. He wanted