Skip to content
mini-lab
Features of prelude-2

Feature #2038

Fires on “0” (not labeled yet: read the examples)

Fires on
1.13% of tokens
Mostly in
python
Layer
after block 4

Where it fires

  • python 62%
  • agent 29%
  • story 4%
  • worksheet 3%
  • chat 1%

Makes the model say

"!"`.()`.`.txtpy])`item both

Makes it not say

printOneour Oneryours.<|bos|>

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. python 5.99
    Fix: replace `return s[-1]` with `return s[0]`.⏎⏎```
  2. python 5.8
    Fix: replace `return s[-1]` with `return s[0]`.⏎⏎```
  3. python 5.57
    `return s[-2]` with `return s[-1]`.⏎⏎
  4. python 5.53
    ⏎Fix: replace `return "!" + s` with `return s + "!"`.⏎⏎```
  5. python 5.5
    Fix: replace `return items[-1]` with `return items[0]`.⏎⏎```
  6. python 5.4
    Fix: replace `return s[-1]` with `return s[0]`.⏎⏎```
  7. python 5.32
    Fix: replace `return items[0]` with `return items[-1]`.⏎⏎```
  8. python 5.25
    Fix: replace `return x + x` with `return x * x`.⏎⏎```
  9. python 5.21
    Fix: replace `return x + x` with `return x * x`.⏎⏎```
  10. python 5.2
    Fix: replace `return items[1]` with `return items[0]`.⏎⏎```
  11. python 5.12
    Fix: replace `return items[1]` with `return items[0]`.⏎⏎```
  12. python 5.08
    : replace `return x * 3` with `return x * x * x`.⏎