Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #197

Fires on “ a” (not labeled yet: read the examples)

Fires on
0.32% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 40%
  • agent 35%
  • chat 23%
  • worksheet 1%
  • python 1%

Makes the model say

opencodeOaid == same end sun],

Makes it not say

there plus something() thatitemsizedlist

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 3.48
    ing colors and playing together.<|bos|>Once upon a time, in a big forest, there
  2. story 3.45
    to show everyone back home!<|bos|>Once upon a time, in a small village, there
  3. story 3.43
    <|bos|>Once upon a time, in a big garden, there
  4. story 3.43
    short stories and add numbers.<|assistant_end|><|bos|>Once upon a time, in a small town, there
  5. story 3.37
    Once upon a time, in a big sky, there
  6. story 3.34
    asking me for a story!<|assistant_end|><|bos|>Once upon a time, in a small house, there
  7. story 3.34
    495<|assistant_end|><|bos|>Once upon a time, in a small house near the
  8. story 3.33
    And they played happily ever after.<|bos|>Once upon a time, in a small town, there
  9. story 3.33
    the rest of the nice day.<|bos|>Once upon a time, in a small town, there
  10. story 3.27
    answer is 13.<|assistant_end|><|bos|>Once upon a time, in a bright, sunny house
  11. story 3.27
    can I help you today?<|assistant_end|><|bos|>Once upon a time, in a small town, there
  12. story 3.26
    return s + "!"⏎```⏎<|bos|>Once upon a time, in a small house, lived