Skip to content
mini-lab
Features of prelude-2

Feature #2142

Fires on “ of” (not labeled yet: read the examples)

Fires on
0.49% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 44%
  • story 22%
  • worksheet 15%
  • chat 13%
  • python 6%

Makes the model say

54 happy looked we9 sad low

Makes it not say

)⏎ `rite testultipl there So

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 2.27
    welcome, Mia." They played with the toy car together and had lots of fun.<|bos|>7
  2. story 2.2
    decided to give the ball to Tim. They played together and had lots of fun.⏎After
  3. story 2.18
    Bear! You are incredible!" They played with the ball and had lots of fun. From that
  4. story 1.97
    , I want to be your friend!" They played together and had lots of fun.⏎Soon
  5. story 1.89
    "You're so silly, Spot!" They played together and had lots of fun.<|bos|><|user_start|>
  6. story 1.87
    ."⏎Sue played with the whistle all day, and they had lots of fun. But when
  7. story 1.86
    toy inside.⏎Tim and Sue played with the toy and had lots of fun. They were
  8. story 1.85
    swam with the fish every day. They all played together and had lots of fun. And they
  9. story 1.83
    tape." They both played with the tape together, and they had lots of fun. From that
  10. agent 1.83
    py`, `test_calc.py` and `test_listlib.py`.<|assistant_end|><|bos|>
  11. story 1.83
    <|bos|>Once upon a time there was a boy named Billy. He was 3 years old and
  12. story 1.79
    They took turns swinging on the vine. They were having lots of fun. Then,