Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #3625

Fires on “4” (not labeled yet: read the examples)

Fires on
1.02% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 86%
  • chat 9%
  • agent 2%
  • python 2%
  • story 1%

Makes the model say

number= play stillconfig Dadlastay

Makes it not say

54 code averageSorry3identent

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 8.55
    657 plus 135 is 95792.<|bos|><|system_start|>tools
  2. worksheet 7.92
    3 + 2981 = 79424.⏎Mia has
  3. worksheet 7.85
    332 and 3206 is 4538.⏎21
  4. worksheet 7.84
    8 + 6 = 22314.⏎What is
  5. worksheet 7.76
    89 + 218 = 42607.⏎Add
  6. worksheet 7.74
    6 = 87119⏎Compute 7
  7. worksheet 7.46
    504 plus 1230 equals 3734.<|bos|>Bug:
  8. worksheet 7.46
    644 and 7701 is 9345.⏎what is
  9. worksheet 7.45
    776 and 6227 is 9003.⏎If you
  10. worksheet 7.4
    377 and 6662 is 9039.<|bos|>Once upon
  11. worksheet 7.37
    5246 plus 23 is 55269.⏎Lucy had
  12. worksheet 7.31
    26 plus 9184 is 75610.⏎The sum