Skip to content
mini-lab
Features of prelude-2

Feature #1972

Fires on “,” (not labeled yet: read the examples)

Fires on
0.38% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 88%
  • chat 10%
  • agent 2%
  • python 1%
  • worksheet 1%

Makes the model say

oldStringageicepath<|think_start|>SE WORD

Makes it not say

```iak testu asking spo same

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 5.12
    He went for a jog near the beach. He saw his friend, a cat named Tom
  2. story 5.07
    film, but he didn't know how.⏎Tom asked his friend, a happy dog named
  3. story 5.01
    grass with water to make a special soup.⏎Lily asked her friend, Tom, "Do
  4. story 4.96
    match on the ground. He wanted to eat it, but his friend,
  5. story 4.91
    , thick cat named Tom went for a walk. He saw his friend, a little dog named
  6. story 4.91
    , he went closer and sniffed the box.⏎Max's friend, a small cat named
  7. story 4.9
    friends, so he ran to find them.⏎Tom saw his friend, Ann, who was
  8. story 4.9
    , but it was too heavy to carry.⏎Tim saw his friend, Sam, walking by
  9. story 4.9
    it, but it was too hard for him.⏎Tom's friend, a little girl named
  10. story 4.89
    the knob, but he was too small. He asked his friend, a little bird named
  11. story 4.88
    a plan to get the cake without working.⏎Tom asked his friend, a clever mouse named
  12. story 4.86
    did not know what to do.⏎Bouncy's friend, Bunny, saw B