Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #234

Fires on “py” (not labeled yet: read the examples)

Fires on
0.44% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 62%
  • story 13%
  • worksheet 13%
  • python 6%
  • chat 6%

Makes the model say

<|assistant_end|>ThankHi xMe:` live like

Makes it not say

-Shepython! herself him SheFinally

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. agent 5.36
    py:⏎ Line
  2. agent 5.36
    py with a function smallest
  3. agent 5.36
    py`.<|assistant_end|><|bos|>#
  4. agent 5.36
    py` and `script
  5. agent 5.36
    py (1 replacement)
  6. agent 5.36
    py", line 3
  7. agent 5.36
    py<|tool_end|><|assistant_start|>Created `
  8. agent 5.36
    py:⏎ Line
  9. agent 5.36
    py`: it used `
  10. agent 5.36
    py, lines 1
  11. agent 5.36
    py<|tool_call_end|><|assistant_end|><|tool_start|>all
  12. agent 5.36
    py (1 replacement)