Skip to content
mini-lab
Features of prelude-2

Feature #1384

Fires on “ a” (not labeled yet: read the examples)

Fires on
1.30% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 83%
  • chat 13%
  • agent 1%
  • python 1%
  • worksheet 1%

Makes the model say

dog toy favorite cat red his toys friend

Makes it not say

<|assistant_end|>$replaceAll Python{expression passes=**/*.

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 5.67
    . He lived in a small house with his mom, dad, and his old dog, Max
  2. story 5.37
    Lily. Lily liked to print pictures of her favorite animals. She had a big cut on her
  3. story 5.33
    Tom. Tom liked to organize his toys every day. He had a toy axe
  4. story 5.1
    upon a time, there was a little girl named Sue. She had a big test at school
  5. story 5.09
    time, there was a man who liked to sell things. He had a small shop near a
  6. story 5.06
    Once upon a time, there was a girl named Lucy. She had a pretty uniform
  7. story 4.94
    time, there was a gifted little girl named Amy. Amy had a pink dress that she
  8. chat 4.93
    Amy. She loved to pretend and play with her toys. Amy had a big box full of
  9. story 4.89
    Once upon a time, there was a girl named Lily. She had a big box of make
  10. story 4.87
    upon a time, there was a little girl named Mia. Mia had a big garden where she
  11. story 4.79
    Amy. She loved to pretend and play with her toys. Amy had a big box full of
  12. story 4.76
    upon a time, there was a little boy named Tom. He had a big toy box.