Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #3196

Fires on “ thought” (not labeled yet: read the examples)

Fires on
0.29% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 63%
  • story 28%
  • python 5%
  • chat 3%
  • worksheet 0%

Makes the model say

, spot real thought tight andm little

Makes it not say

<|user_start|> import ForBug wagged<|tool_start|>One lived

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 4.23
    because it could not fly. Poppy wanted to help the bug. She thought she could change the
  2. story 4.22
    The bird saw a big, soft cloud in the sky. The bird thought, "I can
  3. story 4.19
    named Tim wanted to play. He saw a pond with water. He thought, "I want
  4. story 4.15
    , he saw a big, yummy leaf on a tall tree. He thought, "I want
  5. story 4.13
    .⏎Then, Tom saw a small hole under the fence. He thought, "Maybe I
  6. story 4.01
    Max was very excited to play outside. He saw a big tree and thought it would be fun
  7. story 3.99
    ⏎One day, the little lizard saw a big leaf. He thought it would be fun
  8. story 3.89
    day, Tim went to the park. He saw a big tree and thought his boot might be
  9. story 3.86
    looked and looked for his toy. He saw something in the water and thought it was his ball
  10. story 3.83
    Sue went to play in the park. She saw a big tree and thought it was interesting.
  11. story 3.82
    the park with his rope to play. He saw a big tree and thought it would be fun
  12. story 3.8
    named Jane wanted to make the room nice and bright.⏎Jane thought of a plan.