Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #2535

Fires on “<|arg|>” (not labeled yet: read the examples)

Fires on
0.26% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 53%
  • agent 20%
  • story 17%
  • python 10%
  • worksheet 0%

Makes the model say

expressionnylowerscript<|arg|>gestICENSE prelude

Makes it not say

# of0. end And$ a

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 2.93
    is 7.<|assistant_end|><|user_start|>Plus 9?<|user_end|><|assistant_start|><|tool_call_start|>calculator<|arg|>expression=7 +
  2. chat 2.9
    242 = ?<|user_end|><|assistant_start|><|tool_call_start|>calculator<|arg|>expression=15
  3. chat 2.82
    is 8.<|assistant_end|><|user_start|>Plus 6?<|user_end|><|assistant_start|><|tool_call_start|>calculator<|arg|>expression=8 +
  4. chat 2.82
    97 to that?<|user_end|><|assistant_start|><|tool_call_start|>calculator<|arg|>expression=72
  5. chat 2.76
    add 53 and 3 for me?<|user_end|><|assistant_start|><|tool_call_start|>calculator<|arg|>expression=53
  6. chat 2.76
    . How many balls does Max have now?<|user_end|><|assistant_start|><|tool_call_start|>calculator<|arg|>expression=89
  7. chat 2.75
    <|assistant_end|><|user_start|>Now add 41 to the result.<|user_end|><|assistant_start|><|tool_call_start|>calculator<|arg|>expression=1
  8. chat 2.75
    ?<|user_end|><|assistant_start|><|tool_call_start|>calculator<|arg|>expression=86
  9. chat 2.75
    ?<|user_end|><|assistant_start|><|tool_call_start|>calculator<|arg|>expression=3 +
  10. chat 2.74
    .<|assistant_end|><|user_start|>And add 6 to that?<|user_end|><|assistant_start|><|tool_call_start|>calculator<|arg|>expression=50
  11. chat 2.74
    <|tool_call_start|>calculator<|arg|>expression=6
  12. chat 2.73
    What if you add 1 more?<|user_end|><|assistant_start|><|tool_call_start|>calculator<|arg|>expression=89