Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #660

Fires on “7” (not labeled yet: read the examples)

Fires on
0.74% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 95%
  • python 1%
  • chat 1%
  • agent 1%
  • story 1%

Makes the model say

scaredpyhttpsnumsated mini<|assistant_end|>ed

Makes it not say

also add where then Now Tomnder R

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 7.07
    7079 plus 28 equals 17107.⏎Could you
  2. worksheet 6.73
    536 and 8, you get 47544.<|bos|>Once upon
  3. worksheet 6.65
    and 6591, you get 90517.⏎44
  4. worksheet 6.6
    9976 plus 11 is 29987.<|bos|><|user_start|>he
  5. worksheet 6.49
    64879 and 7 is 64886.<|bos|><|system_start|>Answer
  6. worksheet 6.43
    007 plus 470 equals 47477.⏎40
  7. worksheet 6.31
    and found 6 more. Now Anna has 75421 apples.<|bos|>Once
  8. worksheet 6.2
    7 and 436, you get 13873.<|bos|>One day
  9. worksheet 6.2
    59836 plus 7 equals 59843.<|bos|>Once upon
  10. worksheet 6.17
    3897 + 22 = 63919⏎135
  11. worksheet 6.14
    68 + 9838 = 54206<|bos|><|system_start|>tools:
  12. worksheet 6.13
    35 and 9227 is 77362.⏎The sum