Skip to content
mini-lab
Features of prelude-2

Feature #1225

Fires on “ and” (not labeled yet: read the examples)

Fires on
0.73% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 86%
  • chat 9%
  • worksheet 2%
  • agent 2%
  • python 1%

Makes the model say

they said count asked when saw Let,

Makes it not say

<|assistant_end|> myprint<|user_end|>Her<|assistant_start|>His =

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 5.05
    went to the kitchen and found a big bowl
  2. story 4.86
    she went to the stove and started to play.
  3. story 4.76
    Tim. Max wanted to find out, so he went to the door and barked. Tim said
  4. story 4.73
    she was a baby.⏎She went to the living room and saw her brother Tom
  5. story 4.68
    tree and wanted to get a closer look. He ran to the tree and started to climb.
  6. story 4.65
    pool and was struggling in the water. Mia quickly ran outside and called out to Tom
  7. story 4.6
    could buy something to eat with it.⏎He went to the store and asked for some food
  8. story 4.57
    sea. Every day, Bob would go outside and raise his hands to
  9. story 4.44
    a fun place to play!" So, he ran to the patch and found his friend,
  10. story 4.43
    He wanted to play with his car.⏎Tim went to the kitchen and saw his mom.
  11. story 4.39
    replace the ball with a new one.⏎Max ran to the store and found a new red
  12. story 4.39
    and wanted to see what was under it. He ran to the tree and found a little bird