Skip to content
mini-lab
Features of prelude-2

Feature #3652

Fires on “4” (not labeled yet: read the examples)

Fires on
1.24% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 68%
  • python 16%
  • story 8%
  • chat 5%
  • worksheet 3%

Makes the model say

Fix can is next tc than count

Makes it not say

Addedprint]`.<|arg|><|assistant_start|> help

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. agent 3.57
    be `reverse`. It now prints:⏎```⏎r⏎tac⏎
  2. agent 3.56
    It now prints:⏎```⏎music cat⏎```
  3. agent 3.54
    <|tool_end|><|assistant_start|>`script.py` printed:⏎```⏎3⏎```<|assistant_end|><|user_start|>
  4. agent 3.41
    <|assistant_start|>`script.py` printed:⏎```⏎4⏎lemon lemon⏎
  5. agent 3.39
    <|assistant_start|>Created `main.py`. It prints:⏎```⏎Hello, Kai
  6. agent 3.37
    banana⏎<|tool_end|><|assistant_start|>`script.py` printed:⏎```⏎python banana⏎```<|assistant_end|>
  7. agent 3.32
    <|tool_end|><|assistant_start|>`hello.py` printed:⏎```⏎False⏎5.0
  8. agent 3.31
    `main.py` printed:⏎```⏎-4⏎```<|assistant_end|><|user_start|>
  9. agent 3.29
    4⏎<|tool_end|><|assistant_start|>`app.py` printed:⏎```⏎4⏎```<|assistant_end|><|bos|>
  10. agent 3.29
    4⏎<|tool_end|><|assistant_start|>`script.py` printed:⏎```⏎4⏎```<|assistant_end|><|bos|>
  11. agent 3.29
    n` should be `even`. It now prints:⏎```⏎2⏎36⏎
  12. agent 3.28
    hello⏎<|tool_end|><|assistant_start|>`script.py` printed:⏎```⏎True⏎1⏎pizza