Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #171

Fires on “ had” (not labeled yet: read the examples)

Fires on
0.19% of tokens
Mostly in
python
Layer
after block 4

Where it fires

  • python 77%
  • agent 9%
  • story 9%
  • worksheet 3%
  • chat 3%

Makes the model say

⏎ up a fun there( save

Makes it not say

wayRename homes{"Ben first<|think_end|>T

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. python 1.79
    has `if a <
  2. python 1.79
    has `return [n
  3. worksheet 1.79
    has 96 cookies
  4. story 1.74
    cake from the back of the
  5. story 1.72
    had an idea. He
  6. story 1.72
    had an idea. She
  7. story 1.72
    had a lot of fun
  8. story 1.72
    had used the spear
  9. story 1.72
    had so much fun and
  10. story 1.72
    had been gifted the
  11. chat 1.72
    had dust to play
  12. story 1.53
    an idea. She wanted to plan a special surprise for all the people in her village. She