Skip to content
mini-lab
Features of prelude-2

Feature #682

Fires on “ small” (not labeled yet: read the examples)

Fires on
0.78% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 70%
  • agent 12%
  • chat 11%
  • python 4%
  • worksheet 4%

Makes the model say

, watch look door my Butupet

Makes it not say

<|assistant_end|>many kind passes$itedcalculatorSorry

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 2.83
    One day, he saw something strange inside the box. It was a small green ball. Tim
  2. story 2.66
    ⏎Mia opened the box and found a surprise inside. It was a small, incredible toy.
  3. story 2.59
    coming from a bush nearby. He peeped in and saw a tiny kitten struggling
  4. chat 2.54
    as they finished, something unexpected happened. A big, wet frog jumped
  5. chat 2.54
    ⏎Mia opened the box and found a surprise inside. It was a small, incredible toy.
  6. story 2.53
    she noticed something attractive in the shadows. It was a small house with lots of
  7. story 2.52
    . She was very happy. But then, something unexpected happened. A small mouse came out of
  8. chat 2.48
    ⏎Mia opened the box and found a surprise inside. It was a small, incredible toy.
  9. story 2.39
    . Lily ran to answer it. She opened the door and saw a small cat outside.⏎
  10. story 2.38
    Then, something strange happened. A big wind came and blew
  11. story 2.37
    felt happy with his new rock friend.⏎Suddenly, Tim saw a small cat stuck in a
  12. story 2.36
    a strange noise coming from behind her. She turned around and saw a big wolf!⏎The