Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #3645

Fires on “ ” (not labeled yet: read the examples)

Fires on
1.01% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 80%
  • chat 8%
  • agent 8%
  • story 2%
  • python 1%

Makes the model say

named together ` (big( mathlib9

Makes it not say

nowockedmany stringsatedNowen wouldn

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 9.66
    you add 54039 and 2, you get 5404
  2. worksheet 9.57
    you add 47536 and 8, you get 4754
  3. worksheet 9.33
    you add 44764 and 2, you get 4476
  4. worksheet 8.98
    657.⏎28345 plus 2 is 2834
  5. worksheet 8.82
    add 74502 and 67, you get 7456
  6. worksheet 8.8
    023.⏎77290 plus 8 is 7729
  7. worksheet 8.78
    you add 13800 and 6, you get 1380
  8. worksheet 8.73
    you add 46269 and 8, you get 4627
  9. worksheet 8.64
    5415 apples and found 6 more. Now Anna has 7542
  10. worksheet 8.58
    you add 22792 and 6, you get 2279
  11. worksheet 8.54
    14.<|assistant_end|><|bos|>71834 plus 2 is 7183
  12. worksheet 8.52
    9200.⏎7455 plus 8 equals 7463