Skip to content
mini-lab
Features of prelude-2

Feature #2922

Fires on “ forgot” (not labeled yet: read the examples)

Fires on
0.35% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 69%
  • chat 18%
  • agent 9%
  • worksheet 2%
  • python 1%

Makes the model say

EADMEexpressionoldString defines equals<|think_start|>dou<|assistant_start|>

Makes it not say

a c and b closer end "<|bos|>

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 3.6
    ."⏎He got up and followed his mom to the kitchen. He forgot about the clock and
  2. chat 3.49
    behind the couch.⏎By the end of the day, everyone forgot about the kitten.
  3. story 3.43
    She said goodbye to her friends and started to walk away. But she forgot her little mirror on
  4. story 3.3
    played with the ball. They laughed and had a good time. Tommy forgot about his bricks
  5. story 3.26
    nodded and they went inside the house. They ate yummy food and Tim forgot all about the ghost
  6. story 3.2
    table. Sue was so excited to eat the soup. But, she forgot to be careful.
  7. story 3.16
    Lily and stayed by her side. They continued their walk, and Max forgot about the cat.
  8. story 3.08
    and licked Anna's face. Anna laughed and hugged the dog. She forgot about her baby doll
  9. story 3.04
    with the toy soldier together. And for a little while, they forgot about the war and
  10. story 3.03
    played in the snow all day. They had so much fun that Tim forgot about the door.
  11. story 3.03
    boy and dog.⏎Tom and Spot felt happy and cozy. They forgot about the lightning
  12. story 3.01
    quack!" the penguin nodded.⏎Anna and Ben smiled. They forgot about their snow war