Skip to content
mini-lab
Features of prelude-2

Feature #100

Fires on “ play” (not labeled yet: read the examples)

Fires on
0.22% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 72%
  • chat 15%
  • agent 11%
  • worksheet 1%
  • python 1%

Makes the model say

outside the1 be and plusbig woke

Makes it not say

readjoinmathFrom continuedls join from

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 2.96
    a little boy named Tim. Tim was a normal boy who liked to play with his toys.
  2. story 2.95
    stories and add numbers.<|assistant_end|><|bos|>Tom is a boy who likes to play with his toys.
  3. story 2.91
    660 shells.<|bos|>Tom was a boy who liked to play with his toys.
  4. story 2.8
    returns `2`.⏎<|bos|>Tom was a young boy who liked to play with his sack.
  5. story 2.78
    ⏎17⏎<|bos|>Lily and Anna were sisters who liked to play dress-up.
  6. story 2.77
    their new friend.<|bos|>Sara and Ben are twins. They like to play with their toys.
  7. story 2.77
    in the open field.<|bos|>Lily and Ben were twins who liked to play with their toys.
  8. story 2.72
    numbers.<|assistant_end|><|bos|>Lila and Sam were best friends. They liked to play in the park every
  9. story 2.72
    33.<|assistant_end|><|bos|>Ben and Sam were brothers who liked to play with blocks. They
  10. story 2.71
    the water anymore.<|assistant_end|><|bos|>Lila was a tall girl who liked to play outside. She had
  11. story 2.71
    numbers.<|assistant_end|><|bos|>Anna and Lily were best friends. They liked to play with dolls and dress
  12. story 2.68
    there to protect him.<|bos|>Tom is a big dog who likes to play with his friends.