Skip to content
mini-lab
Features of prelude-2

Feature #408

Fires on “If” (not labeled yet: read the examples)

Fires on
0.37% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 29%
  • python 28%
  • worksheet 23%
  • chat 14%
  • agent 6%

Makes the model say

py = Sue python ` m Tim<|bos|>

Makes it not say

ing closer whoer facee kindhes

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. python 3.17
    =9, 910<|think_end|>910<|assistant_end|><|bos|># test_textlib.py
  2. python 3.1
    88<|think_end|>The answer is 88.<|assistant_end|><|bos|># test_lists.py
  3. worksheet 3.03
    0655 more. Now Tom has 3
  4. worksheet 3.0
    08 more. Now Anna has 2
  5. worksheet 2.91
    6 + 663 = 669.⏎If you add 7
  6. worksheet 2.9
    and 14 is 7749.⏎If you add 6
  7. python 2.9
    .py`.<|assistant_end|><|bos|># test_words.py
  8. worksheet 2.86
    3 is 568.⏎If you add 1
  9. worksheet 2.84
    ⏎0 plus 679 is 679.⏎If you add 4
  10. worksheet 2.82
    10 + 787 = 797.⏎If you add 8
  11. worksheet 2.79
    + 8603 = 8676.⏎If you add 4
  12. worksheet 2.79
    37644 = 37726.⏎If you add 9