Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #3148

Fires on “ upon” (not labeled yet: read the examples)

Fires on
0.41% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 33%
  • worksheet 30%
  • chat 21%
  • agent 14%
  • python 0%

Makes the model say

hugged hugs_iestBut", sure

Makes it not say

happen excited soft very fun liked")) plan

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 2.13
    model: I can tell short stories and add numbers.<|assistant_end|><|bos|>Once upon a time, there
  2. story 2.12
    trained from scratch on a laptop by mini-lab.<|assistant_end|><|bos|>Once upon a time, there
  3. story 2.12
    , edit and fix the Python files in this project.<|assistant_end|><|bos|>Once upon a time, there
  4. story 2.12
    : I can only tell short stories and add numbers.<|assistant_end|><|bos|>Once upon a time, there
  5. story 2.12
    . I can only tell short stories and add numbers.<|assistant_end|><|bos|>Once upon a time, in
  6. story 2.1
    trained from scratch on a laptop by mini-lab.<|assistant_end|><|bos|>Once upon a time, there
  7. story 2.08
    trained from scratch on a laptop by mini-lab.<|assistant_end|><|bos|>Once upon a time, there
  8. story 2.06
    : I can only tell short stories and add numbers.<|assistant_end|><|bos|>Once upon a time, there
  9. story 2.06
    together.<|bos|>Once upon a time there was
  10. chat 2.06
    7, 7⏎0+3: 0+3+1=4,
  11. story 2.06
    : I can only tell short stories and add numbers.<|assistant_end|><|bos|>Once upon a time, there
  12. story 2.05
    it.⏎The end.<|bos|>Once upon a time, in