Skip to content
mini-lab
Features of prelude-2

Feature #1872

Fires on “ small” (not labeled yet: read the examples)

Fires on
0.21% of tokens
Mostly in
python
Layer
after block 4

Where it fires

  • python 41%
  • story 29%
  • chat 25%
  • agent 3%
  • worksheet 2%

Makes the model say

from2⏎opencode yearsdouble5 factorial

Makes it not say

" becauseist if how at: watch

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 3.63
    495<|assistant_end|><|bos|>Once upon a time, in a small house near the big
  2. story 3.52
    rest of the nice day.<|bos|>Once upon a time, in a small town, there lived
  3. story 3.43
    I help you today?<|assistant_end|><|bos|>Once upon a time, in a small town, there was
  4. story 3.42
    to show everyone back home!<|bos|>Once upon a time, in a small village, there was
  5. story 3.42
    s + "!"⏎```⏎<|bos|>Once upon a time, in a small house, lived a
  6. story 3.41
    get rewards for trying.<|bos|>Once upon a time, in a small town, there lived
  7. story 3.39
    stories and add numbers.<|assistant_end|><|bos|>Once upon a time, in a small town, there lived
  8. chat 3.38
    story.<|user_end|><|assistant_start|>Sure! Once upon a time, in a small house, there was
  9. story 3.37
    me for a story!<|assistant_end|><|bos|>Once upon a time, in a small house, there was
  10. story 3.35
    they played happily ever after.<|bos|>Once upon a time, in a small town, there was
  11. story 3.34
    is 74.<|assistant_end|><|bos|>Once upon a time, in a small town, there was
  12. story 3.34
    498.<|assistant_end|><|bos|>Once upon a time, in a small house, lived a