Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #2987

Fires on “ =” (not labeled yet: read the examples)

Fires on
0.81% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 38%
  • worksheet 24%
  • agent 24%
  • story 7%
  • python 6%

Makes the model say

"+ mean Python<|bos|>} if

Makes it not say

8675 gamemFixed Mr

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 5.37
    121949.⏎6 + 810 = 816
  2. worksheet 5.26
    77 = 777
  3. worksheet 5.1
    get 84252.⏎7 + 26 = ?⏎07
  4. worksheet 5.08
    6 = 871
  5. worksheet 5.08
    6 = 156
  6. worksheet 5.04
    75 = 289
  7. python 4.97
    = 1⏎ for
  8. worksheet 4.97
    = ?⏎56
  9. worksheet 4.97
    = 171
  10. worksheet 4.97
    = 210
  11. worksheet 4.97
    = 623
  12. agent 4.97
    = 0⏎1