Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #711

Fires on “ day” (not labeled yet: read the examples)

Fires on
0.39% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 49%
  • story 29%
  • chat 13%
  • worksheet 4%
  • python 4%

Makes the model say

long Oner<|assistant_end|>red pot dad ops

Makes it not say

that she not the *ious were)`

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 3.29
    the bottle all day. He put the
  2. story 3.25
    and the squirrel. They would run, jump, and climb trees all day long. They were
  3. story 3.0
    to play with his cheap ball. The boy would kick the ball all day long.⏎One
  4. story 2.98
    a big yard to play in. He loved to run and jump all day long. One day
  5. story 2.97
    playful cat named Mimi. Mimi loved to play with her ball all day long. She would
  6. story 2.95
    he had never seen before.⏎Tom played with the new ball all day. He had so
  7. story 2.93
    , there was a playful puppy. He ran around the house all day long. The puppy
  8. story 2.93
    apon, a sword. He loved to play with his sword all day. One day,
  9. chat 2.92
    Bob. Bob was restless. He liked to run and jump all day. One day,
  10. story 2.91
    bounced very high. Max and Lily played with the new red ball all day long, and they
  11. story 2.85
    the snow all day.<|bos|>Once upon
  12. chat 2.84
    forgot all about the crazy string. She played with her new toy all day long.<|assistant_end|><|bos|>