Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #1944

Fires on “ new” (not labeled yet: read the examples)

Fires on
0.26% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 73%
  • chat 13%
  • agent 9%
  • worksheet 3%
  • python 2%

Makes the model say

s friend toy friends st onef house

Makes it not say

)` wagged but both>>>Spot]`us

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. agent 4.04
    new file tools.py
  2. story 4.04
    new to the factory
  3. story 4.04
    new game in the store
  4. story 4.04
    new things together. As
  5. chat 3.94
    they clapped their hands and laughed. They were so happy they made a new friend and trad
  6. story 3.88
    and made a new friend.<|bos|>One
  7. story 3.74
    and play all day long.⏎One day, Ducky met a new friend named Froggy
  8. story 3.66
    said, "Max, let's go to the store and buy a new red ball!" Max
  9. story 3.61
    bathe in the sun every day. One day, Tim met a new friend, a little
  10. story 3.61
    . They went back to their march, happy to have met a new friend.<|bos|><|user_start|>
  11. story 3.6
    me free!" Fred was surprised, but he smiled. He made a new friend, and they
  12. story 3.59
    trains along the tracks.⏎One day, they found a new train in their toy