Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #3975

Fires on “8” (not labeled yet: read the examples)

Fires on
1.58% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 69%
  • python 13%
  • worksheet 10%
  • story 6%
  • chat 2%

Makes the model say

] with trained idea functionoldString home light

Makes it not say

7```46Once5 `=

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 2.31
    8 equals 85936.⏎63897 + 22
  2. worksheet 2.12
    7, you get 544.⏎30938 + 59
  3. worksheet 2.11
    4⏎1 + 4 = 5⏎62362 plus 44
  4. worksheet 2.1
    you get 26903.⏎36575 + 20
  5. worksheet 2.08
    6 + 26 = 32⏎92576 + 1 =
  6. worksheet 2.05
    can tell short stories and add numbers.<|assistant_end|><|bos|>28559 plus 75
  7. worksheet 2.04
    py`, line 5.<|assistant_end|><|bos|>Calculate 59178 + 19
  8. worksheet 2.04
    + 10 = 79.⏎68641 + 35
  9. worksheet 2.01
    answer is 1314.<|assistant_end|><|bos|>71834 plus 2 is
  10. worksheet 2.0
    0 is 59657.⏎28345 plus 2 is
  11. worksheet 1.99
    7 is 13497.⏎32291 plus 63
  12. worksheet 1.98
    you get 79001.⏎24049 + 17