Skip to content
mini-lab
Features of prelude-2

Feature #3762

Fires on “ They” (not labeled yet: read the examples)

Fires on
1.53% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 52%
  • agent 42%
  • chat 3%
  • worksheet 2%
  • python 1%

Makes the model say

is has says<|tool_call_start|> eat == wants`,

Makes it not say

were all could so while would her being

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 3.05
    <|tool_end|><|assistant_start|>All tests pass.<|assistant_end|><|bos|>Anna and Ben are twins. They like to play in
  2. story 3.05
    some green plants. They smell good.⏎"What are these?" Anna asks.⏎"
  3. story 3.0
    Lily and Ben are friends. They like to play in the garden. They see many flowers and
  4. story 2.99
    under the ground.⏎Anna and Ben sit on the seats. They look out the window
  5. story 2.99
    .<|bos|>Lily and Tom are friends. They like to play outside. They have bikes
  6. story 2.98
    too, Sam. I was selfish. Can we share the toys?" Tom says.⏎They
  7. story 2.96
    cactus was now their new friend.<|bos|>Sara and Ben are twins. They like to play with
  8. story 2.94
    94.<|assistant_end|><|bos|>Lily and Ben are playing in the kitchen. They have a big bowl
  9. story 2.89
    Tom and Ann are friends. They like to play in the park. They see a big hill
  10. story 2.89
    greeting.py`.<|assistant_end|><|bos|>Sam and Ben are brothers. They like to play with
  11. story 2.86
    Anna and Ben are twins. They like to play in the park. They have a big ball
  12. story 2.84
    6665⏎```<|assistant_end|><|bos|>Tim and Mia are twins. They like to play with