Skip to content
mini-lab
Features of prelude-2

Feature #2037

Fires on “Bug” (not labeled yet: read the examples)

Fires on
0.21% of tokens
Mostly in
python
Layer
after block 4

Where it fires

  • python 78%
  • agent 8%
  • chat 7%
  • story 5%
  • worksheet 2%

Makes the model say

Python: todayul fromonfig important has

Makes it not say

⏎ed were ideaasred piecesased

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. python 7.85
    ⏎code!⏎ROBOT⏎```<|assistant_end|><|bos|>Bug: `average_
  2. python 7.1
    model: I can only tell short stories and add numbers.<|assistant_end|><|bos|>Bug: `lower_
  3. python 7.03
    ```⏎<|bos|>Bug: `mean_
  4. python 6.83
    that. I can only tell short stories and add numbers.<|assistant_end|><|bos|>Bug: `greet`
  5. python 6.82
    $ python3 test_listlib.py⏎all tests passed⏎<|bos|>Bug: `power`
  6. python 6.78
    $ python3 test_utils.py⏎all tests passed⏎<|bos|>Bug: `mean_
  7. python 6.74
    , `is_positive(4)` returns `True`.⏎<|bos|>Bug: `excite`
  8. python 6.74
    <|bos|>Bug: `max_
  9. python 6.74
    <|bos|>Bug: `add`
  10. python 6.72
    and add numbers, step by step or with a calculator.<|assistant_end|><|bos|>Bug: `total`
  11. python 6.68
    It prints:⏎```⏎It works!⏎```<|assistant_end|><|bos|>Bug: `max_
  12. python 6.63
    rest under the tree, wearing their matching gray shoes.<|assistant_end|><|bos|>Bug: `product`