Skip to content
mini-lab
Features of prelude-2

Feature #2230

Fires on “,” (not labeled yet: read the examples)

Fires on
0.55% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 81%
  • agent 9%
  • chat 8%
  • worksheet 1%
  • python 1%

Makes the model say

I you we let can look why who

Makes it not say

typo seek!")[::ultipl<|assistant_start|>g shouted

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 11.32
    The fairy said, "Tim, you have been selfish
  2. story 11.25
    had an idea. She said, "Max, let's go to
  3. story 10.94
    talking to him about it. She said to him, "Johnny, you are gifted
  4. chat 10.8
    best friend, a squirrel named Sam.⏎Sam said, "Ben, let's play a
  5. story 10.71
    play with. Bob thought for a moment and then said, "Sam, let's share my
  6. chat 10.01
    Tim saw his friend, Sue. Sue said, "Tim, do you want to
  7. story 9.89
    es.⏎The truck man got out and said, "Buddy, I have a box
  8. story 9.84
    squirrel, came to help. Sam said, "Ben, we need to move
  9. chat 9.71
    .⏎Tim saw his friend, Sue. Sue said, "Tim, do you want to
  10. story 9.68
    Tim's mom saw him looking at the bug and said, "Tim, don't touch that
  11. story 9.68
    , he said, "Sally, look at my impress
  12. story 9.67
    he decided to share it with Lily.⏎Tom said, "Lily, let's share my