Skip to content
mini-lab
Features of prelude-2

Feature #3515

Fires on “h” (not labeled yet: read the examples)

Fires on
0.98% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 40%
  • story 25%
  • chat 22%
  • worksheet 9%
  • python 4%

Makes the model say

ooam lose3alinsup

Makes it not say

they prints moral waited named```)`.Fix

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 3.43
    said, "Let's play a new game. It is called 'bathe the toy
  2. story 3.41
    iting him.⏎At the party, they played a game called "match". They
  3. story 2.99
    in his shop. He painted it with bright colors and wrote "Share" on it
  4. story 2.9
    in her mind.⏎Sally asked, "Mom, what does 'bitter' mean?"
  5. story 2.78
    ummy were at the beach. Joey was so excited to build sandcastles with his
  6. story 2.77
    has a big button and a big hole. A sign says "Shrink or G
  7. story 2.59
    the shell, Ben. But you have to help me build a sandcastle too,"
  8. story 2.59
    be nice to each other, share our toys, and always say 'please' and '
  9. story 2.55
    month. For example, in January they drew snowmen, in A
  10. story 2.53
    sand.⏎"Come on, Sara, help me build a sandcastle!" he
  11. story 2.49
    <|assistant_end|><|bos|>Once upon a time, there was a big, soft mattress. It was
  12. story 2.48
    Once upon a time, there was a small pigeon. It hop-hop-hopped