Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #495

Fires on “ He” (not labeled yet: read the examples)

Fires on
0.53% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 63%
  • agent 28%
  • python 6%
  • chat 3%
  • worksheet 0%

Makes the model say

<|assistant_end|><|user_start|><|user_end|>Once<|think_start|>+ made calculator

Makes it not say

they They.TheyWe dog first times

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 4.2
    He liked to look at
  2. chat 4.2
    He missed the sea,
  3. story 4.2
    He pleaded
  4. story 4.2
    He said he needed all
  5. story 4.2
    He said, "Stop
  6. story 4.2
    He shakes it and
  7. story 4.2
    He walked up to the
  8. story 4.2
    He wanted to play with
  9. story 4.2
    He just wanted to st
  10. story 4.2
    He learned not to play
  11. story 3.7
    She was scared. "
  12. story 3.7
    She mixed everything together and