Skip to content
mini-lab
Features of prelude-2

Feature #3011

Fires on “ started” (not labeled yet: read the examples)

Fires on
0.45% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 80%
  • chat 11%
  • python 6%
  • agent 2%
  • worksheet 2%

Makes the model say

to as walk]`` way<|arg|>r

Makes it not say

⏎⏎ herself ownerendmd⏎ prettyings

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 4.7
    started to race and C
  2. chat 4.7
    started to go down.
  3. story 4.7
    started to climb the hill
  4. story 4.7
    started to cry on the
  5. story 4.7
    started to talk! The
  6. story 4.7
    started to rain. The
  7. story 4.19
    spot where the sand was wet and smooth. He started to dig and pile up
  8. story 3.97
    rake away and started to play. They both
  9. story 3.92
    would be fun to zoom down the hill.⏎As Zoomy started to go up the hill
  10. story 3.91
    on the rope. Tim tied the rope to a branch and began to swing.⏎While
  11. chat 3.91
    ire. So, Tom took the wire in his mouth and began to climb. When he
  12. story 3.87
    she went to the stove and started to play.⏎Lily