Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #3465

Fires on “3” (not labeled yet: read the examples)

Fires on
2.25% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 89%
  • chat 7%
  • agent 2%
  • python 2%
  • story 1%

Makes the model say

+P<|tool_end|> x still see buglies

Makes it not say

OneOnce asked felt making h seemed H

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 5.66
    and 3870, you get 15423.⏎Lucy had
  2. worksheet 5.42
    40 plus 7857 is 13497.⏎32
  3. worksheet 5.35
    7079 plus 28 equals 17107.⏎Could you
  4. worksheet 5.28
    7 and 436, you get 13873.<|bos|>One day
  5. worksheet 5.09
    70 and 9812 is 13782.⏎The sum
  6. worksheet 5.06
    800 and 6, you get 13806.⏎The sum
  7. worksheet 5.02
    100 and 0, you get 19100.⏎I need
  8. worksheet 5.0
    792 and 6, you get 22798.⏎82
  9. worksheet 4.98
    16249 + 1 = 16250.<|bos|><|system_start|>tools
  10. worksheet 4.97
    926 and 8, you get 14934.<|bos|><|system_start|>tools
  11. worksheet 4.97
    49 and 7433 is 16882.⏎Compute
  12. worksheet 4.95
    7253 and 21 is 7274.⏎17