Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #2222

Fires on “,” (not labeled yet: read the examples)

Fires on
0.30% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 82%
  • python 9%
  • story 7%
  • chat 2%
  • worksheet 1%

Makes the model say

out and sc again r let m

Makes it not say

ageCreate //scripteidege So

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. agent 2.99
    _mathlib.py`.<|assistant_end|><|bos|><|system_start|>tools: edit, glob, grep, question
  2. agent 2.93
    `main.py`.<|assistant_end|><|bos|><|system_start|>tools: edit, glob, grep, question
  3. agent 2.89
    `lib.py`.<|assistant_end|><|bos|><|system_start|>tools: edit, glob, grep, question
  4. agent 2.89
    ops.py`.<|assistant_end|><|bos|><|system_start|>tools: edit, glob, grep, question
  5. agent 2.87
    and they were very happy.<|bos|><|system_start|>tools: edit, glob, grep, question
  6. agent 2.86
    48511.<|bos|><|system_start|>tools: edit, glob, grep, question
  7. agent 2.84
    4<|think_end|>594<|assistant_end|><|bos|><|system_start|>tools: edit, glob, grep, question
  8. agent 2.84
    6313.<|bos|><|system_start|>tools: edit, glob, grep, question
  9. agent 2.84
    _case(s)`.<|assistant_end|><|bos|><|system_start|>tools: edit, glob, grep, question
  10. agent 2.83
    The tests pass now.<|assistant_end|><|bos|><|system_start|>tools: edit, glob, grep, question
  11. agent 2.83
    `stats.py`.<|assistant_end|><|bos|><|system_start|>tools: edit, glob, grep, question
  12. agent 2.83
    The tests pass now.<|assistant_end|><|bos|><|system_start|>tools: edit, glob, grep, question