Skip to content
mini-lab
Features of prelude-2

Feature #2869

Fires on “<|think_start|>” (not labeled yet: read the examples)

Fires on
0.60% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 54%
  • worksheet 41%
  • story 3%
  • agent 1%
  • python 1%

Makes the model say

(-<|think_start|>calculatorAddedscript exclamationdemo upon

Makes it not say

for. they`. car mix little fun

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 6.93
    .<|system_end|><|user_start|>What is 20 + 7?<|user_end|><|assistant_start|><|think_start|>20+0
  2. chat 6.74
    <|bos|><|user_start|>I need to know 8 + 9.<|user_end|><|assistant_start|><|think_start|>8+9:
  3. chat 6.73
    Can you add 65 and 8 for me?<|user_end|><|assistant_start|><|think_start|>65+0
  4. chat 6.63
    .<|assistant_end|><|user_start|>What's 72 + 9?<|user_end|><|assistant_start|><|think_start|>72+0
  5. chat 6.61
    What is the sum of 36 and 1?<|user_end|><|assistant_start|><|think_start|>36+0
  6. chat 6.6
    Can you add 65 and 8 for me?<|user_end|><|assistant_start|><|think_start|>65+0
  7. chat 6.53
    .<|system_end|><|user_start|>What is 54 plus 5?<|user_end|><|assistant_start|><|think_start|>54+0
  8. chat 6.51
    Sue.<|bos|><|user_start|>What's 2 + 5?<|user_end|><|assistant_start|><|think_start|>2+5:
  9. chat 6.45
    !<|assistant_end|><|user_start|>What is 40 + 6?<|user_end|><|assistant_start|><|think_start|>40+0
  10. chat 6.45
    Find the sum of 90 and 86.<|user_end|><|assistant_start|><|think_start|>90+8
  11. chat 6.43
    the calculator.<|system_end|><|user_start|>Calculate 7 + 0.<|user_end|><|assistant_start|><|think_start|>7+0:
  12. chat 6.41
    calculator.<|system_end|><|user_start|>What's 6 + 0?<|user_end|><|assistant_start|><|think_start|>6+0: