Skip to content
mini-lab
Features of prelude-2

Feature #2244

Fires on โ€œ.โ€ (not labeled yet: read the examples)

Fires on
1.55% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 83%
  • chat 14%
  • agent 2%
  • python 1%
  • worksheet 0%

Makes the model say

Bug friend am``` So But unexpected Then

Makes it not say

โŽ<|bos|> alwaysnding everyone adds and

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 3.57
    saw a little bird. The bird was helpless and could not fly. "Mom, look
  2. story 3.55
    sky. The bird thought, "I can relax on the cloud." The bird flew up
  3. story 3.52
    Lily saw a magic ice-cream cone. It could shrink things! Lily asked the ice
  4. story 3.49
    in a puddle. The puddle was too small for the fish to swim. Tim wanted to help
  5. story 3.48
    words were too big. He felt hurt that he could not read it. He asked his dad
  6. story 3.47
    tree. The tree was on the rail. The train could not go. The train was sad
  7. chat 3.4
    Tom and Max did not get along. They would fight about the music. Tom wanted to listen
  8. story 3.36
    animal felt very sad. He knew he needed help to fix his home. So, he went
  9. story 3.36
    big for them to play with. They didn't know what to do. Sue's mom came
  10. chat 3.35
    to burn the ancient tree. All the animals in the hole were scared. But then, something
  11. story 3.34
    what was inside. She tried to open it, but it was stuck. She asked her friends
  12. chat 3.32
    in its nose. It tried to stop it, but it could not. The jellyfish snee