Skip to content
mini-lab
Features of prelude-2

Feature #472

Fires on “ he” (not labeled yet: read the examples)

Fires on
1.10% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 75%
  • chat 13%
  • agent 10%
  • worksheet 1%
  • python 0%

Makes the model say

was liked loved could had can likes wanted

Makes it not say

⏎ reverse One!" trained," theming

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 4.45
    , a small squirrel came to the wise owl. He was sad because he could not find his
  2. story 4.26
    One day, Bob met another dog named Sam. Sam was sad because he didn't have a
  3. story 4.24
    pretty view from the sky. Tim felt ashamed because he could not fly like
  4. story 4.14
    day, Spot saw a little boy named Tim. Tim was sad because he lost his base
  5. story 4.14
    fence! Tom was sad because he could not find a
  6. story 4.11
    answer is 552.<|assistant_end|><|bos|>Lily was a green bird who liked to talk a
  7. story 4.07
    ⏎Then, Spot saw a boy named Tim. Tim was sad because he lost his magaz
  8. story 4.02
    come inside now," her mom said.⏎Daisy was upset because she did not want to
  9. chat 3.99
    to have the balloon. But he felt a little guilty because he didn't say thank
  10. story 3.95
    not there. Bow started to cry. He was very sad because he could not find his
  11. story 3.94
    to panic because he did not like getting
  12. story 3.92
    spread and destroyed the place. The boy was sad, because he could not have his