Skip to content
mini-lab
Features of prelude-2

Feature #3879

Fires on “0” (not labeled yet: read the examples)

Fires on
0.89% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 80%
  • worksheet 12%
  • agent 6%
  • story 1%
  • python 0%

Makes the model say

out inside.reatoout result tight

Makes it not say

saidase played let:` also play more

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 3.41
    <|tool_call_end|><|assistant_end|><|tool_start|>756<|tool_end|><|assistant_start|>The answer is 756.<|assistant_end|><|bos|>Bug
  2. chat 3.3
    <|user_start|>Plus 65?<|user_end|><|assistant_start|>The answer is 318.<|assistant_end|><|user_start|>Plus
  3. chat 3.29
    56<|tool_end|><|assistant_start|>The answer is 1656.<|assistant_end|><|bos|>#
  4. chat 3.25
    <|tool_call_end|><|assistant_end|><|tool_start|>261<|tool_end|><|assistant_start|>The answer is 261.<|assistant_end|><|bos|>Once
  5. chat 3.24
    <|tool_call_end|><|assistant_end|><|tool_start|>257<|tool_end|><|assistant_start|>The answer is 257.<|assistant_end|><|bos|>Once
  6. chat 3.23
    <|tool_start|>1280<|tool_end|><|assistant_start|>The answer is 1280.<|assistant_end|><|user_start|>Write
  7. chat 3.18
    stickers does Tom have now?<|user_end|><|assistant_start|>The answer is 759.<|assistant_end|><|user_start|>1
  8. chat 3.18
    <|tool_call_end|><|assistant_end|><|tool_start|>320<|tool_end|><|assistant_start|>The answer is 320.<|assistant_end|><|bos|><|system_start|>
  9. chat 3.16
    <|tool_call_end|><|assistant_end|><|tool_start|>175<|tool_end|><|assistant_start|>The answer is 175.<|assistant_end|><|bos|><|system_start|>
  10. chat 3.15
    <|tool_call_end|><|assistant_end|><|tool_start|>759<|tool_end|><|assistant_start|>The answer is 759.<|assistant_end|><|user_start|>What
  11. chat 3.13
    <|tool_call_end|><|assistant_end|><|tool_start|>262<|tool_end|><|assistant_start|>The answer is 262.<|assistant_end|><|bos|><|system_start|>
  12. chat 3.12
    <|user_end|><|assistant_start|>The answer is 1420.<|assistant_end|><|user_start|>What