Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #1153

Fires on “ then” (not labeled yet: read the examples)

Fires on
0.88% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 56%
  • chat 17%
  • agent 16%
  • python 6%
  • worksheet 5%

Makes the model say

<|assistant_end|> return again model testsON ever ==

Makes it not say

# AtOne doing him lot])) water

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 2.13
    surprised because it hadn
  2. story 1.94
    very happy. They played with the fixed toy all day.⏎But then, something unexpected happened
  3. story 1.85
    the tree.⏎The cable helped the bird get free. But then, something unexpected happened
  4. story 1.85
    he dropped the face and ran away! But he was glad that the bird was still safe.
  5. story 1.84
    picked up the cat. Spot was happy the cat was safe. But then, the big bird
  6. story 1.84
    with the new ball all day. He had so much fun! But then, the ball hit
  7. chat 1.82
    But then, something unexpected happened
  8. story 1.82
    But then, the sky got
  9. chat 1.8
    not sad anymore.⏎But then, something unexpected happened! The tiny fish started to grow bigger
  10. chat 1.8
    They played with the ball, and the princess was very happy. But then, the princess acc
  11. story 1.78
    flew through the air! They all clapped and cheered for Tim. But then, they saw something
  12. chat 1.78
    ran around the park, making gun sounds and having fun.⏎But then, Tim slipped on