Skip to content
mini-lab
Features of prelude-2

Feature #2614

Fires on “ went” (not labeled yet: read the examples)

Fires on
0.45% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 59%
  • story 23%
  • python 7%
  • agent 6%
  • chat 5%

Makes the model say

Added towards_ intoCreated<|assistant_end|> projectstats

Makes it not say

topant grow0ches playing clapped reach

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 3.64
    bird fly higher. They both played together in the park until the sun went down.<|assistant_end|><|bos|>
  2. story 3.57
    Lily laughed and clapped her hands. They played all day until the sun went down. Fluffy and
  3. story 3.48
    took turns hiding and finding the bicycle, playing together until the sun went down.<|bos|>One
  4. story 3.45
    both laughed and kept playing the match game. They played until the sun went down, and they
  5. story 3.43
    with the rod, and Max was very happy.⏎As the sun went down, Max and
  6. chat 3.41
    , having lots of fun. They played all evening until the sun went down. They were
  7. story 3.41
    ed the game. Leo and Bobo played with the ball until the sun went down. Then,
  8. story 3.41
    could help his new friend. They played in the field until the sun went down.<|bos|>Sue
  9. story 3.32
    new friends and shared the wonders with them. When the sun went down, Tim rode
  10. story 3.31
    ⏎So, Spot and Bunny played on the patch until the sun went down. They were
  11. story 3.3
    went into the net. They were both happy and played until the sun went down.<|bos|><|user_start|>
  12. story 3.27
    day playing in the field, laughing and having fun. When the sun went down, they were