Skip to content
mini-lab
Features of prelude-2

Feature #795

Fires on “ for” (not labeled yet: read the examples)

Fires on
0.65% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 45%
  • python 24%
  • agent 18%
  • chat 9%
  • worksheet 3%

Makes the model say

[- last(k ate([{=**/

Makes it not say

<|assistant_end|>: test idea dance colorsight mad

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 4.85
    , "Yes, I want to play with you."⏎They played for a long time,
  2. story 4.77
    do?" The cat thought for a moment and said
  3. story 4.59
    and followed life. They walked for miles,
  4. story 4.59
    my steam is not strong."⏎The wise old tree thought for a moment and said
  5. story 4.55
    your dad does not like me. What can we do?" Sue thought for a moment and said
  6. story 4.54
    down, and then he kicked it around. He played with the ball for a long time.
  7. story 4.51
    ⏎Poppy thought for a moment and had
  8. story 4.28
    insisted, "Please play with me."⏎The bird thought for a moment and said
  9. story 4.26
    bear who was stuck in a sack. The bear had been in there for days and it felt
  10. story 4.2
    .⏎Sara thought for a moment. She
  11. story 4.2
    the snow with the kids, but I can't." The squirrel thought for a moment and said
  12. story 4.19
    sad because he didn't have a toy to play with. Bob thought for a moment and then