Skip to content
mini-lab
Features of prelude-2

Feature #989

Fires on “What” (not labeled yet: read the examples)

Fires on
0.54% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 51%
  • worksheet 19%
  • agent 19%
  • story 9%
  • python 1%

Makes the model say

is new they happened noise's I

Makes it not say

], down continuedpytest underop ground5

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 5.56
    equals 74.⏎What's 81
  2. worksheet 5.44
    3 = 560.⏎What is 10
  3. worksheet 5.17
    8 plus 9 equals 37.⏎What is 50
  4. worksheet 4.94
    8 + 6 = 22314.⏎What is the sum of
  5. worksheet 4.85
    366 + 5 = 371.⏎What's 55
  6. worksheet 4.84
    5 more. Now Lily has 1370 books.⏎What is the sum of
  7. chat 4.82
    , edit and fix the Python files in this project.<|assistant_end|><|bos|><|user_start|>What can you do?
  8. worksheet 4.8
    84 is 10661.⏎What is 2 +
  9. chat 4.78
    2288 = 2353.<|bos|><|user_start|>What is 1 +
  10. chat 4.75
    I only know how to tell stories and add numbers.<|assistant_end|><|bos|><|user_start|>What is the sum of
  11. worksheet 4.74
    3150 = 88009.⏎What is the sum of
  12. chat 4.73
    9 + 844 = 853.<|bos|><|user_start|>What's the weather