Skip to content
mini-lab
Features of prelude-2

Feature #2286

Fires on “.” (not labeled yet: read the examples)

Fires on
0.21% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 64%
  • agent 26%
  • story 5%
  • python 4%
  • chat 1%

Makes the model say

?⏎⏎=⏎ pyO sees?"

Makes it not say

great so perfect9 bright tree nearby kept

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 1.37
    46 + 0 = 46.⏎Lucy had
  2. worksheet 1.34
    So 5 + 7 = 12.<|bos|><|system_start|>tools:
  3. worksheet 1.33
    9 + 1 = 10.⏎Max has
  4. worksheet 1.33
    29 = 84.⏎432
  5. worksheet 1.32
    9⏎So 69 + 10 = 79.⏎686
  6. worksheet 1.26
    ⏎So 48 + 23 = 71.⏎3+4
  7. worksheet 1.23
    20⏎So 7 + 13 = 20.⏎9 plus
  8. worksheet 1.23
    49 = 53.<|bos|>899
  9. worksheet 1.22
    46⏎So 1 + 45 = 46.⏎If you add
  10. worksheet 1.22
    12⏎So 4 + 8 = 12.⏎731
  11. worksheet 1.22
    equals 74.⏎What's
  12. worksheet 1.21
    3 = 560.⏎What is