Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #357

Fires on “<|think_end|>” (not labeled yet: read the examples)

Fires on
0.64% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 71%
  • worksheet 17%
  • agent 10%
  • story 2%
  • python 0%

Makes the model say

<|think_end|><|tool_call_start|>Renamed typo<|think_start|>path<|user_start|><|assistant_start|>

Makes it not say

0 and32,c: it

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 4.65
    9+0+1=10, 1006<|think_end|>The answer is
  2. chat 4.56
    9+2+1=12, 1265<|think_end|>1265
  3. chat 4.51
    9+7+1=17, 1747<|think_end|>The answer is
  4. chat 4.48
    9+0+1=10, 103<|think_end|>The answer is
  5. chat 4.48
    8+8+1=17, 1706<|think_end|>The answer is
  6. chat 4.44
    8: 9+8=17, 176<|think_end|>The answer is
  7. chat 4.43
    9+6+1=16, 1691<|think_end|>The answer is
  8. chat 4.43
    9+7+1=17, 1747<|think_end|>The answer is
  9. chat 4.41
    7+5+1=13, 1349<|think_end|>Sure! The answer
  10. chat 4.38
    7+2+1=10, 1002<|think_end|>The answer is
  11. chat 4.37
    6+5+1=12, 1204<|think_end|>The answer is
  12. chat 4.36
    4+9+1=14, 1406<|think_end|>1406