Skip to content
mini-lab
Features of prelude-2

Feature #903

Fires on “ to” (not labeled yet: read the examples)

Fires on
5.48% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 82%
  • chat 12%
  • agent 3%
  • python 2%
  • worksheet 1%

Makes the model say

picked pick itpy wanted eat " took

Makes it not say

plus<|bos|> goodbyeBye waveye=**/ gone

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 5.69
    and stones. He found a big stick and thought, "I can make a fun game
  2. story 5.2
    et. Then, he saw a long stick on the ground. He had an idea!⏎
  3. story 5.04
    a long string with a big knot in it. The bird wanted to use the string for
  4. story 4.98
    . One day, the bear found a sharp stick on the ground. He picked it up and
  5. story 4.89
    flexible branch. Tim saw a pretty cone under the tree. He wanted to
  6. story 4.86
    taking things. One day, Spot saw a red ball. He decided to take it. He
  7. story 4.85
    small, flexible toy inside the bag. Sue liked the toy, so she took it out to
  8. story 4.83
    in her yard. It was a piece of copper. Sue wanted to know what it was
  9. story 4.79
    noticed a big, orange book and thought it looked fun. He decided to kick it. He
  10. story 4.76
    a beautiful, shiny key. Sue and her mom were very surprised. They didn't know what
  11. story 4.76
    box. The black box was a present. Lily was very happy. She wanted to open the
  12. story 4.75
    found a spray bottle in his house. He thought it would be fun to play with it.