Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #385

Fires on “,” (not labeled yet: read the examples)

Fires on
0.53% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 96%
  • chat 2%
  • story 2%
  • python 0%
  • worksheet 0%

Makes the model say

n there letLet Let bestpath

Makes it not say

multiplyMomHello grew68ir **

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. agent 5.48
    <|assistant_end|><|bos|><|system_start|>tools: edit, glob, grep, question, read, shell,
  2. agent 5.39
    <|assistant_end|><|bos|><|system_start|>tools: edit, glob, grep, question, read, shell,
  3. agent 5.38
    <|assistant_end|><|bos|><|system_start|>tools: edit, glob, grep, question, read, shell,
  4. agent 5.38
    <|assistant_end|><|bos|><|system_start|>tools: edit, glob, grep, question, read, shell,
  5. agent 5.35
    <|assistant_end|><|bos|><|system_start|>tools: edit, glob, grep, question, read, shell,
  6. agent 5.33
    ⏎<|bos|><|system_start|>tools: edit, glob, grep, question, read, shell,
  7. agent 5.29
    ⏎<|bos|><|system_start|>tools: edit, glob, grep, question, read, shell,
  8. agent 5.29
    <|assistant_end|><|bos|><|system_start|>tools: edit, glob, grep, question, read, shell,
  9. agent 5.28
    .<|bos|><|system_start|>tools: edit, glob, grep, question, read, shell,
  10. agent 5.27
    <|assistant_end|><|bos|><|system_start|>tools: edit, glob, grep, question, read, shell,
  11. agent 5.26
    <|assistant_end|><|bos|><|system_start|>tools: edit, glob, grep, question, read, shell,
  12. agent 5.26
    ⏎<|bos|><|system_start|>tools: edit, glob, grep, question, read, shell,