Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #928

Fires on “p” (not labeled yet: read the examples)

Fires on
0.32% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 91%
  • story 6%
  • chat 1%
  • worksheet 1%
  • python 0%

Makes the model say

youred plusve thankfuler<|arg|>et

Makes it not say

So( dark fun I very turned three

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. agent 3.4
    make new friends.<|bos|><|system_start|>tools: edit, glob, grep, question, read
  2. agent 3.38
    with each other.<|bos|><|system_start|>tools: edit, glob, grep, question, read
  3. agent 3.37
    named Ollie.<|assistant_end|><|bos|><|system_start|>tools: edit, glob, grep, question, read
  4. agent 3.36
    day long.<|assistant_end|><|bos|><|system_start|>tools: edit, glob, grep, question, read
  5. agent 3.35
    named Tim.<|assistant_end|><|bos|><|system_start|>tools: edit, glob, grep, question, read
  6. agent 3.35
    297<|assistant_end|><|bos|><|system_start|>tools: edit, glob, grep, question, read
  7. agent 3.35
    pass now.<|assistant_end|><|bos|><|system_start|>tools: edit, glob, grep, question, read
  8. agent 3.34
    the park.<|assistant_end|><|bos|><|system_start|>tools: edit, glob, grep, question, read
  9. agent 3.34
    615<|bos|><|system_start|>tools: edit, glob, grep, question, read
  10. agent 3.33
    976<|assistant_end|><|bos|><|system_start|>tools: edit, glob, grep, question, read
  11. agent 3.33
    -lab.<|assistant_end|><|bos|><|system_start|>tools: edit, glob, grep, question, read
  12. agent 3.32
    from their friends.<|bos|><|system_start|>tools: edit, glob, grep, question, read