Skip to content
mini-lab
Features of prelude-2

Feature #3183

Fires on “ went” (not labeled yet: read the examples)

Fires on
0.23% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 76%
  • chat 12%
  • agent 10%
  • worksheet 1%
  • python 1%

Makes the model say

r by offub hitfrom: stir

Makes it not say

=return<|assistant_end|>command<|assistant_start|> equals pt

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 6.87
    with them all day. Max was very happy.⏎When the sun went down, Max knew
  2. story 6.83
    very happy and played with the ghost all day.⏎As the sun went down, it was
  3. story 6.83
    could help his new friend. They played in the field until the sun went down.<|bos|>Sue
  4. story 6.8
    new friends and shared the wonders with them. When the sun went down, Tim rode
  5. story 6.79
    back. They had so much fun flying together.⏎As the sun went down, the bird
  6. story 6.75
    with the rod, and Max was very happy.⏎As the sun went down, Max and
  7. story 6.74
    day playing in the field, laughing and having fun. When the sun went down, they were
  8. story 6.66
    with blocks. She was having lots of fun.⏎As the sun went down, Mia heard
  9. story 6.6
    gging his tail. They played all day long. When the sun went down, they all
  10. chat 6.59
    bird fly higher. They both played together in the park until the sun went down.<|assistant_end|><|bos|>
  11. story 6.58
    ⏎So, Spot and Bunny played on the patch until the sun went down. They were
  12. chat 6.49
    , having lots of fun. They played all evening until the sun went down. They were