Skip to content
mini-lab
Features of prelude-2

Feature #208

Fires on “The” (not labeled yet: read the examples)

Fires on
0.29% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 73%
  • agent 18%
  • story 6%
  • python 2%
  • worksheet 1%

Makes the model say

Added answerFixed} function!")/ Python

Makes it not say

that a in with1: for0

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 3.81
    + 790<|tool_call_end|><|assistant_end|><|tool_start|>1018<|tool_end|><|assistant_start|>The answer is 1
  2. chat 3.79
    31 + 81<|tool_call_end|><|assistant_end|><|tool_start|>612<|tool_end|><|assistant_start|>The answer is 6
  3. chat 3.78
    expression=89 + 1<|tool_call_end|><|assistant_end|><|tool_start|>90<|tool_end|><|assistant_start|>The answer is 9
  4. chat 3.74
    82 + 0<|tool_call_end|><|assistant_end|><|tool_start|>1082<|tool_end|><|assistant_start|>The answer is 1
  5. chat 3.67
    7 + 750<|tool_call_end|><|assistant_end|><|tool_start|>967<|tool_end|><|assistant_start|>The answer is 9
  6. chat 3.63
    expression=68 + 1<|tool_call_end|><|assistant_end|><|tool_start|>69<|tool_end|><|assistant_start|>The answer is 6
  7. chat 3.63
    95 + 88<|tool_call_end|><|assistant_end|><|tool_start|>183<|tool_end|><|assistant_start|>The answer is 1
  8. chat 3.63
    164 + 5<|tool_call_end|><|assistant_end|><|tool_start|>169<|tool_end|><|assistant_start|>The answer is 1
  9. chat 3.62
    =51 + 30<|tool_call_end|><|assistant_end|><|tool_start|>81<|tool_end|><|assistant_start|>The answer is 8
  10. chat 3.61
    =76 + 20<|tool_call_end|><|assistant_end|><|tool_start|>96<|tool_end|><|assistant_start|>The answer is 9
  11. chat 3.59
    750 + 9<|tool_call_end|><|assistant_end|><|tool_start|>759<|tool_end|><|assistant_start|>The answer is 7
  12. chat 3.57
    =10 + 79<|tool_call_end|><|assistant_end|><|tool_start|>89<|tool_end|><|assistant_start|>The answer is 8