Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #116

Fires on “ is” (not labeled yet: read the examples)

Fires on
0.20% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 54%
  • worksheet 33%
  • agent 8%
  • story 4%
  • python 1%

Makes the model say

it what " where window who head

Makes it not say

count back count same lower too numbers tools

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 3.75
    tools: calculator<|system_end|><|system_start|>Do not use the calculator.<|system_end|><|user_start|>What is 62 +
  2. chat 3.67
    <|system_start|>Do not use the calculator.<|system_end|><|user_start|>What is the sum of
  3. chat 3.63
    tools: calculator<|system_end|><|system_start|>Do not use the calculator.<|system_end|><|user_start|>What is 87 plus
  4. chat 3.59
    is 87.<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>What is 90 plus
  5. chat 3.54
    tools: calculator<|system_end|><|system_start|>Do not use the calculator.<|system_end|><|user_start|>What is 3 plus
  6. chat 3.48
    stories and add numbers.<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>What is your name?<|user_end|>
  7. chat 3.48
    <|system_start|>You are mini, a small and friendly assistant.<|system_end|><|user_start|>What is 54 plus
  8. chat 3.47
    8<|think_end|>648<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>What is your name?<|user_end|>
  9. chat 3.46
    was not hungry anymore.<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>What is 694
  10. chat 3.44
    3=3, 39<|think_end|>39<|assistant_end|><|bos|><|user_start|>What is 12 times
  11. chat 3.43
    answer is 9.<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>What is the sum of
  12. chat 3.43
    tools: calculator<|system_end|><|system_start|>Do not use the calculator.<|system_end|><|user_start|>What is 552