Skip to content
mini-lab
Features of prelude-2

Feature #3134

Fires on “ for” (not labeled yet: read the examples)

Fires on
0.95% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 64%
  • agent 14%
  • chat 13%
  • python 8%
  • worksheet 1%

Makes the model say

many a fun two them all the getting

Makes it not say

<|assistant_end|>hedpython⏎ ananON) outside

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 4.13
    's play near the big tree."⏎They played near the big tree for a long time.
  2. story 4.02
    down, and then he kicked it around. He played with the ball for a long time.
  3. story 3.97
    bear who was stuck in a sack. The bear had been in there for days and it felt
  4. story 3.92
    , and they both went to hide.⏎The rain did not stop for a long time.
  5. story 3.87
    ight."⏎The boat rocked back and forth in the water
  6. story 3.71
    . The sun began to set, and Lucy's mom called her inside for dinner. Lucy left
  7. story 3.68
    He wanted his thread back. So, Spot decided to fight the cat for his thread. They
  8. story 3.67
    together!"⏎They played all day, throwing the ball back and forth. They laughed
  9. story 3.66
    , but there was no big bug.⏎They played at the park for a while and then
  10. story 3.63
    he poked the ball, and it moved for him too. They
  11. story 3.58
    was inside his neighbor's purple case. He had been curious about it for so long.⏎
  12. story 3.52
    answered with a cheerful hello of its own. The two talked together for a while and Billy