Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #747

Fires on “ `” (not labeled yet: read the examples)

Fires on
0.57% of tokens
Mostly in
python
Layer
after block 4

Where it fires

  • python 69%
  • agent 15%
  • worksheet 10%
  • story 4%
  • chat 2%

Makes the model say

1print (ice `[2ti

Makes it not say

and. again another more happy! smiled

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. python 6.03
    <|bos|>Bug: `max_of`
  2. python 6.03
    <|bos|>Bug: `add` should add
  3. python 5.82
    ```⏎<|bos|>Bug: `mean_list`
  4. python 5.54
    how_many(items)` counts the items.<|assistant_end|><|bos|>Bug: `combine` should return
  5. python 5.38
    is_positive(4)` returns `True`.⏎<|bos|>Bug: `excite` should return
  6. python 5.32
    s!<|user_end|><|assistant_start|>Sure! You're welcome!<|assistant_end|><|bos|>Bug: `average_list`
  7. python 5.24
    799 = 95095.<|bos|>Bug: `flip` should reverse
  8. python 5.24
    ⏎Bug: `vowels` should count
  9. python 5.24
    ⏎Bug: `exclaim` should add
  10. python 5.2
    <|tool_end|><|assistant_start|>The answer is 756.<|assistant_end|><|bos|>Bug: `max_item`
  11. python 5.2
    the tree, wearing their matching gray shoes.<|assistant_end|><|bos|>Bug: `product` should multiply
  12. python 5.19
    1287 = 1569<|bos|>Bug: `exclaim` should add