Skip to content
mini-lab
Features of prelude-2

Feature #2785

Fires on “What” (not labeled yet: read the examples)

Fires on
1.57% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 38%
  • agent 33%
  • python 14%
  • worksheet 9%
  • story 5%

Makes the model say

is tests < from >oldString": tail

Makes it not say

D# tryverx sadrepeatre

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 6.37
    2288 = 2353.<|bos|><|user_start|>What is 1 +
  2. chat 6.28
    9 + 844 = 853.<|bos|><|user_start|>What's the weather
  3. chat 6.15
    , edit and fix the Python files in this project.<|assistant_end|><|bos|><|user_start|>What can you do?
  4. chat 6.14
    400 = 39589.<|bos|><|user_start|>What is the sum of
  5. chat 6.07
    . I can only tell short stories and add numbers.<|assistant_end|><|bos|><|user_start|>What is 36
  6. chat 6.0
    and catch the ball, happy to be with his friends.<|bos|><|user_start|>What is 82
  7. chat 5.95
    but by their actions and how they treat you.<|bos|><|user_start|>What is your name?
  8. chat 5.89
    6<|think_end|>The answer is 1006.<|assistant_end|><|bos|><|user_start|>What's your name?
  9. chat 5.87
    , 9, 9])` returns `9`.⏎<|bos|><|user_start|>What can you do?
  10. chat 5.86
    05<|think_end|>The answer is 505.<|assistant_end|><|bos|><|user_start|>What's your name?
  11. chat 5.84
    0⏎⏎$ python3 script.py⏎True⏎<|bos|><|user_start|>What is the capital
  12. chat 5.82
    Try asking me for a story!<|assistant_end|><|bos|><|user_start|>What's your name?