Skip to content
mini-lab
Features of prelude-2

Feature #2516

Fires on “ liked” (not labeled yet: read the examples)

Fires on
0.45% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 72%
  • chat 12%
  • python 7%
  • agent 6%
  • worksheet 3%

Makes the model say

i toake playing editourython[

Makes it not say

equals,"⏎!#?"MyThe

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 6.36
    friends to play with every day.<|bos|>Ben is a big boy who likes to help his mom
  2. story 6.32
    was always there to protect him.<|bos|>Tom is a big dog who likes to play with his
  3. story 5.87
    houses, happy with their tasty snack.<|bos|>Ben is a boy who likes to dig in the
  4. story 5.85
    and add numbers.<|assistant_end|><|bos|>Lila and Sam were best friends. They liked to play in the
  5. story 5.81
    and add numbers.<|assistant_end|><|bos|>Anna and Lily were best friends. They liked to play with dolls
  6. story 5.77
    tell short stories and add numbers.<|assistant_end|><|bos|>Tom is a boy who likes to play with his
  7. story 5.77
    scared of the water anymore.<|assistant_end|><|bos|>Lila was a tall girl who liked to play outside.
  8. story 5.65
    is 552.<|assistant_end|><|bos|>Lily was a green bird who liked to talk a lot
  9. story 5.64
    333.<|assistant_end|><|bos|>Ben and Sam were brothers who liked to play with blocks
  10. story 5.54
    6])⏎17⏎<|bos|>Lily and Anna were sisters who liked to play dress-
  11. story 5.52
    and add numbers.<|assistant_end|><|bos|>Lily and Ben were best friends. They liked to play in the
  12. story 5.51
    6<|think_end|>6<|assistant_end|><|bos|>Lily and Tom were best friends. They liked to play in the