Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #887

Fires on “ see” (not labeled yet: read the examples)

Fires on
0.09% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 41%
  • story 40%
  • chat 12%
  • python 5%
  • worksheet 1%

Makes the model say

all the what itemsMy its intoThat

Makes it not say

== can main`,=**/ful<|system_start|>are

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 1.88
    exploring outside and found a big hole in the ground. She wanted to see what was inside,
  2. story 1.87
    present. Lily was very happy. She wanted to open the present and see what was inside.
  3. story 1.82
    , they saw a big hole in the ceiling. They wanted to see what was on the
  4. story 1.81
    The box was amazing. It was green and shiny. She wanted to see what was inside the
  5. story 1.8
    They saw a big box with a bow on it. They wanted to see what was inside.
  6. agent 1.79
    hell<|arg|>command=
  7. story 1.66
    y, I found a big chest! Let's open it and see what's inside!"
  8. story 1.63
    , he saw a big jar on a high shelf. He wanted to see what was inside the
  9. story 1.58
    er if we can have some
  10. story 1.58
    One day, Tim saw a big freezer. He wanted to see what was inside.
  11. story 1.57
    box had a surprise inside. Max was very happy. He wanted to see what was inside the
  12. story 1.5
    he saw a big tent. He wanted to enter the tent to see what was inside.