Skip to content
mini-lab
Features of prelude-2

Feature #870

Fires on “ on” (not labeled yet: read the examples)

Fires on
0.60% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 42%
  • story 42%
  • chat 7%
  • python 5%
  • worksheet 4%

Makes the model say

many happy their smiled smilesaw happily new

Makes it not say

," So friend away⏎ asking off would

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 2.02
    her older brother walked into the room. He had a mischievous smile on
  2. chat 1.97
    took a bath and got all clean. After his bath, he put on his paj
  3. story 1.87
    gue about whose truck was better. They raised their voices and made
  4. chat 1.87
    had an idea. They decided to clean the yard together. They put on gloves and
  5. story 1.82
    to come back soon. He started walking home, with a big smile on his face and a
  6. story 1.81
    Then they went to play with their own clothes. They matched their outfits and
  7. story 1.73
    eyes shined bright. The bird thanked Jane and fed its babies. Jane felt
  8. story 1.73
    little boy was so excited, he couldn't wait.⏎They put on their life vest
  9. story 1.7
    ."⏎They started to argue. They raised their voices. They
  10. story 1.69
    walked away.⏎The end.<|bos|>Max has
  11. chat 1.68
    ⏎The dog and Bob enjoyed their rest under the tree,
  12. story 1.67
    smiled and put on her rain boots. They went outside and walked in the rain. Mia