Skip to content
mini-lab
Features of prelude-2

Feature #143

Fires on “ed” (not labeled yet: read the examples)

Fires on
0.85% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 48%
  • python 35%
  • chat 10%
  • story 6%
  • worksheet 1%

Makes the model say

sedlasttened now[::-first pass

Makes it not say

` two garden others being upon range win

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. python 3.31
    items[-1]⏎```
  2. python 2.86
    `.⏎⏎`halve(x)` returns half of x, rounded down.⏎⏎
  3. agent 2.77
    s[-1]<|tool_end|><|assistant_start|>
  4. python 2.76
    ⏎ return s[-1]⏎```
  5. python 2.66
    <|bos|>Bug: `half` should return half of x, rounded down, but it
  6. python 2.65
    2⏎```⏎⏎`halve` returns half of x, rounded down. For example
  7. python 2.63
    <|bos|>Bug: `half` should return half of x, rounded down, but it
  8. python 2.62
    ⏎⏎`half(x)` returns half of x, rounded down.⏎⏎
  9. python 2.59
    / 2⏎⏎⏎def half(x):⏎ return x // 2⏎⏎⏎
  10. agent 2.58
    return s[-1]<|tool_end|><|assistant_start|>
  11. python 2.58
    return s[-1]⏎```
  12. python 2.48
    <|assistant_end|><|bos|>`half(x)` returns half of x, rounded down.⏎⏎