Skip to content
mini-lab
Features of prelude-2

Feature #2207

Fires on “ ” (not labeled yet: read the examples)

Fires on
0.73% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 52%
  • worksheet 33%
  • chat 12%
  • story 2%
  • python 2%

Makes the model say

+⏎ mini thought<|arg|> `oldString

Makes it not say

grow but somethingas please trip car coming

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 3.18
    you add 44764 and 2, you get 4476
  2. worksheet 3.01
    you add 47536 and 8, you get 4754
  3. worksheet 2.78
    you add 54039 and 2, you get 5404
  4. worksheet 2.69
    101⏎66700 + 0 = 6670
  5. worksheet 2.66
    86.⏎98316 + 8 = 9832
  6. worksheet 2.6
    you add 22792 and 6, you get 2279
  7. worksheet 2.59
    42.⏎93823 plus 67 is 9389
  8. worksheet 2.58
    you add 46269 and 8, you get 4627
  9. worksheet 2.56
    you add 13800 and 6, you get 1380
  10. worksheet 2.56
    554.⏎58757 plus 0 is 5875
  11. worksheet 2.55
    657.⏎28345 plus 2 is 2834
  12. worksheet 2.49
    14.<|assistant_end|><|bos|>71834 plus 2 is 7183