Skip to content
mini-lab
Features of prelude-2

Feature #3521

Fires on “ next” (not labeled yet: read the examples)

Fires on
0.44% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 78%
  • story 16%
  • chat 3%
  • worksheet 1%
  • python 1%

Makes the model say

notTrueread fun very<|think_end|> amazed Suddenly

Makes it not say

+ ` always return she "_ him

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 1.57
    to play with some blocks too, but Ben had taken them all. He tried to
  2. python 1.52
    return x > 0⏎```⏎⏎>>> positive(6)⏎True⏎⏎```
  3. story 1.41
    , crabs and shells. They also saw some jellyfish, floating like balloons.
  4. story 1.39
    draw and write. They made a story. A story about a boy and a girl who found
  5. story 1.3
    wooden things, like the table and the cupboard. She was thinking about one of
  6. story 1.3
    of paper. Lily started to write a story about a cat and a dog.⏎In the
  7. story 1.28
    He wanted to test it too. He put his toy telephone next to the big tele
  8. story 1.23
    big, pink elephant to her oasis. She drew the elephant next to the water,
  9. story 1.22
    well, Ellie. You can be in the parade again next time."⏎E
  10. story 1.15
    And just like that, they both drifted off to sleep, dreaming of more fun
  11. chat 1.12
    to make a spicy cake for her mom's birthday. She was very excited.⏎Sally
  12. story 1.1
    from the restaurants, and even riding a carousel. But the