Skip to content
mini-lab
Features of prelude-2

Feature #153

Fires on “ =” (not labeled yet: read the examples)

Fires on
0.97% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 52%
  • worksheet 21%
  • python 18%
  • story 7%
  • chat 2%

Makes the model say

wish and =])) defines `

Makes it not say

test canly maxap happen letteruck

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. python 4.33
    * a` with `return a *
  2. worksheet 3.63
    3865.<|bos|>4716 + 97 = ?⏎47
  3. worksheet 3.5
    8105.⏎970 + 664 = 163
  4. worksheet 3.46
    7793.⏎390 + 68 = 458
  5. worksheet 3.45
    tests passed⏎<|bos|>7505 + 8638 = 161
  6. worksheet 3.42
    4716.⏎6201 + 68 = 626
  7. worksheet 3.4
    72973.⏎369 + 41 = 410
  8. worksheet 3.39
    98.<|bos|>9270 + 6687 = ?⏎92
  9. worksheet 3.38
    2470.⏎357 + 79 = 436
  10. python 3.37
    ⏎⏎Fix: replace `return b + " " + a` with `return a +
  11. worksheet 3.36
    79.⏎76206 + 902 = 771
  12. worksheet 3.35
    121949.⏎6 + 810 = 816