Skip to content
mini-lab
Features of prelude-2

Feature #1439

Fires on “ upon” (not labeled yet: read the examples)

Fires on
0.53% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 38%
  • agent 22%
  • chat 21%
  • worksheet 14%
  • python 4%

Makes the model say

calculator3md8one Lucyai long

Makes it not say

: put g next of like count "!"`.

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 4.8
    .<|assistant_end|><|bos|>Once upon a time there were
  2. story 4.8
    .<|assistant_end|><|bos|>Once upon a time, there
  3. story 4.71
    0.<|assistant_end|><|bos|>Once upon a time, there
  4. story 4.71
    ing colors and playing together.<|bos|>Once upon a time, in
  5. story 4.71
    ```<|assistant_end|><|bos|>Once upon a time, there
  6. chat 4.69
    warmth. Just like warm, soft wool.<|bos|><|user_start|>Once upon a time...
  7. story 4.69
    together.<|bos|>Once upon a time there was
  8. story 4.67
    , edit and fix the Python files in this project.<|assistant_end|><|bos|>Once upon a time, there
  9. story 4.66
    Python files in this project.<|assistant_end|><|bos|>Once upon a time, there
  10. story 4.6
    : I can only tell short stories and add numbers.<|assistant_end|><|bos|>Once upon a time, in
  11. story 4.59
    and add numbers.<|assistant_end|><|bos|>Once upon a time, there
  12. story 4.58
    61799.<|bos|>Once upon a time, there