Skip to content
mini-lab
Features of prelude-2

Feature #2191

Fires on “ how” (not labeled yet: read the examples)

Fires on
0.38% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 36%
  • chat 25%
  • agent 20%
  • worksheet 15%
  • python 4%

Makes the model say

it its unexpectedoldString + the theirvalue

Makes it not say

catw woke bird," done y =

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 4.66
    I'm prelude, and I know how to tell little stories
  2. story 4.49
    't know how to eat herbs
  3. chat 3.94
    and I know how to tell little stories
  4. story 3.8
    was different from the other birds. It wanted to teach the other birds how to fly in a
  5. chat 3.75
    are you good at?<|user_end|><|assistant_start|>I'm prelude, and I know how to tell little stories
  6. chat 3.74
    are you good at?<|user_end|><|assistant_start|>I'm prelude, and I know how to tell little stories
  7. chat 3.69
    know how to tell stories and
  8. story 3.57
    a time there was a bear who loved music. He wanted to learn how to play the dr
  9. chat 3.54
    . I only know how to tell stories and
  10. chat 3.54
    . I only know how to tell stories and
  11. chat 3.52
    what are you good at<|user_end|><|assistant_start|>I'm prelude, and I know how to tell little stories
  12. story 3.51
    "I want to go to a party, but I don't know how to dress." Fin