Skip to content
mini-lab
Features of prelude-2

Feature #44

Fires on “ her” (not labeled yet: read the examples)

Fires on
1.72% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 72%
  • chat 14%
  • agent 10%
  • python 3%
  • worksheet 2%

Makes the model say

park so play the yard room garden forest

Makes it not say

new<|think_end|>]`en noisestwiceRenameddouble

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 4.9
    .<|bos|>One day, a little girl named Lily went to play in her yard. Lily saw
  2. story 4.87
    tree.<|bos|>One day, a little boy named Tim was playing in his room. He was
  3. story 4.55
    ?<|assistant_end|><|bos|>One day, a little girl named Mia was playing in her room. She had
  4. story 4.51
    <|bos|>One day, a little girl named Sue found a rake in her yard. It was
  5. story 4.5
    .<|assistant_end|><|bos|>One day, a little girl named Lucy was playing in her room. She was
  6. story 4.49
    happy.<|assistant_end|><|bos|>One day, a boy named Tim was playing in his yard. He liked
  7. story 4.48
    they could not find it.⏎Later that day, grandma came into the room with a big
  8. story 4.45
    `.⏎<|bos|>One day, a little girl named Lily was playing in her room. She heard
  9. story 4.4
    36.<|bos|>One day, a girl named Lily was playing in her room. She wanted
  10. story 4.38
    .<|assistant_end|><|bos|>One day, a little girl named Mia was playing in her room. She was
  11. chat 4.28
    <|user_end|><|assistant_start|>One day, a big dog named Max went to sleep in his bed.<|assistant_end|><|bos|>
  12. story 4.27
    .<|assistant_end|><|bos|>One day, a little girl named Amy was playing in her room. She had