Skip to content
mini-lab
Features of prelude-2

Feature #3481

Fires on “ there” (not labeled yet: read the examples)

Fires on
0.25% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 75%
  • chat 22%
  • agent 2%
  • worksheet 1%
  • python 0%

Makes the model say

wasOnce were turns became⏎⏎ unexpected say

Makes it not say

assert orwdef cryCreated yoursb

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 4.78
    trying new things can be fun too.<|bos|>Once upon a time, there was a mighty cat
  2. story 4.75
    . And they lived happily ever after.<|bos|>Once upon a time, there was a red squirrel
  3. story 4.71
    and had a lot of fun together.<|bos|>Once upon a time, there was a little girl
  4. story 4.69
    new friends can be fun too.<|assistant_end|><|bos|>Once upon a time, there was a little girl
  5. story 4.69
    they were safe from the flood.<|bos|>Once upon a time, there was a nosy little
  6. story 4.67
    , and they were both very happy.<|bos|>Once upon a time, there was a little girl
  7. story 4.66
    all the way to the stars!<|assistant_end|><|bos|>Once upon a time, there was a pink bunny
  8. story 4.65
    another day of fun and surprises.<|bos|>Once upon a time, there was a boy named
  9. story 4.65
    , and they all became good friends.<|bos|>Once upon a time, there was a naughty squirrel
  10. story 4.65
    his strong, twisty wings.<|assistant_end|><|bos|>Once upon a time, there lived a famous stick
  11. story 4.63
    string to make the nest even better.<|bos|>Once upon a time, there was a little girl
  12. story 4.62
    rare watch made them both very happy.<|bos|>Once upon a time, there was a big,