Skip to content
mini-lab
Features of prelude-2

Feature #3718

Fires on “ of” (not labeled yet: read the examples)

Fires on
0.48% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 70%
  • agent 11%
  • python 9%
  • chat 7%
  • worksheet 2%

Makes the model say

r subtract work sp ever this take squirrel

Makes it not say

Renamed<|think_end|> saw are kitchen heard text room

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 3.05
    taking turns and being fair with each other. And they became the best of friends.<|bos|>One
  2. story 3.04
    From that day on, the baby and Mr. Bear became the best of friends. They played
  3. story 3.03
    sat in their nest and talked about their day. They were the best of friends.<|bos|><|system_start|>
  4. story 3.01
    cat and the dog always helped each other, and they became the best of friends.<|bos|>One
  5. story 3.0
    They played with their new ball every day, and they became the best of friends. And that
  6. story 2.99
    day together. From that day on, Tom and Tim became the best of friends, all because
  7. story 2.98
    . And from that day on, Tim and the girl became the best of friends.<|bos|>Tom
  8. story 2.95
    boy, Brian, who loved to learn. Every day he would sit in his chair
  9. chat 2.95
    . From that day on, Bobo and Riri were the best of friends, and they
  10. story 2.93
    jog and do yoga together every day. They became the best of friends.<|bos|>#
  11. story 2.87
    little money, but his heart was full of joy. Every morning he would insist on walking
  12. story 2.86
    friends. She was not selfish anymore. Lily and Tim became the best of friends, and they