Skip to content
mini-lab
Features of prelude-2

Feature #3307

Fires on โ€œ,โ€ (not labeled yet: read the examples)

Fires on
2.26% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 47%
  • story 41%
  • chat 6%
  • python 4%
  • worksheet 2%

Makes the model say

and but until just then so. as

Makes it not say

t workedheear<|think_start|>inkakesime

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 6.33
    , and she felt very sad. The unique box of colors was gone, and Lily learned to
  2. story 6.03
    loved Paws very much. Paws was soft and cute, and she made Lily
  3. story 5.9
    one Tuesday, something unexpected happened. The sun was gone, and it was rain
  4. story 5.9
    loved to play with every day. The toy ghost was white and soft, and Tim took it
  5. story 5.85
    the sun. One day, it was very hot outside, but Spot still wanted
  6. story 5.79
    m was gone forever, and the town was
  7. story 5.78
    to make Tom's pain go away. The ball did as Sue said, and Tom's pain
  8. story 5.75
    ice cream started to melt. Suddenly, the spoiled part went away, and the ice cream
  9. story 5.75
    ut the door after he came in. The wind blew the door open, and the water came
  10. story 5.74
    help.โŽBut then, something unexpected happened. The wind blew hard, and the asht
  11. story 5.69
    bus started to move again. Lily felt the bus go fast and slow, and she liked it
  12. story 5.58
    music on her little piano. One day, it was very wet outside, and Lily was inside