Skip to content
mini-lab
Features of prelude-2

Feature #604

Fires on “ They” (not labeled yet: read the examples)

Fires on
1.77% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 79%
  • chat 7%
  • agent 6%
  • python 4%
  • worksheet 4%

Makes the model say

can She == ideareturnShear sees

Makes it not say

Thank<|assistant_end|> goodbyesum lived fix laptop stayed

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 3.54
    tests pass now.<|assistant_end|><|bos|>Lily and Ben are playing with blocks. They like to make tow
  2. story 3.03
    long.⏎"Look, Ben, a carrot!" Lily says. "Can we eat it
  3. story 3.03
    <|bos|>Lily and Ben are twins. They like to play with blocks. They have many blocks of
  4. story 3.01
    "Let's pour some water in the bowl," says Lily. She holds the j
  5. story 2.99
    <|assistant_end|><|bos|>Ben and Mia like to play with their toy vehicles. They have cars, trucks
  6. story 2.94
    like to play in the park. Today they see a big slide. They want to try it
  7. story 2.85
    and happy.<|bos|>Ben and Mia like to play with their toys. They have a lot of
  8. story 2.82
    002.<|assistant_end|><|bos|>Lily and Max are playing a game. They have cards with
  9. story 2.81
    <|bos|>Tim and Sam are friends. They like to play with cars. They have many cars of
  10. story 2.8
    ⏎all tests passed⏎<|bos|>Tom and Lily like to collect things. They have a big box
  11. story 2.75
    in the park. One day, they see a big slide. Lila wants to go on the
  12. story 2.75
    to play in the park. They have a big basket of apples. They want to share them