Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #3613

Fires on “.” (not labeled yet: read the examples)

Fires on
1.24% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 38%
  • agent 35%
  • worksheet 25%
  • story 2%
  • python 1%

Makes the model say

OnceOne One joyanceide<|user_start|>d

Makes it not say

more the left now all still door house

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 2.61
    So 5 + 7 = 12.<|bos|><|system_start|>tools:
  2. worksheet 2.4
    So 75 + 340 = 415.<|bos|><|system_start|>tools:
  3. worksheet 2.4
    9 + 252 = 261.⏎Hey, what
  4. worksheet 2.4
    3070 = 3308.⏎Can you add
  5. worksheet 2.39
    17 + 1669 = 1686.⏎I need to
  6. worksheet 2.39
    ⏎So 48 + 23 = 71.⏎3+4
  7. worksheet 2.36
    9 + 1 = 10.⏎Max has
  8. worksheet 2.35
    3 = 560.⏎What is
  9. worksheet 2.34
    70 = 77.⏎Tom had
  10. worksheet 2.3
    6514 + 96 = 6610.⏎Anna had
  11. worksheet 2.29
    77 = 7771.⏎5 +
  12. worksheet 2.29
    ⏎So 321 + 5 = 326.⏎Find the sum