Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #1277

Fires on “:” (not labeled yet: read the examples)

Fires on
0.12% of tokens
Mostly in
python
Layer
after block 4

Where it fires

  • python 81%
  • agent 10%
  • story 6%
  • chat 2%
  • worksheet 1%

Makes the model say

7 +Onceutils moment6 ofa

Makes it not say

upperThisSorry worked filesDad!")read

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. python 4.96
    <|bos|>Bug: `max_of
  2. python 4.96
    <|bos|>Bug: `add` should
  3. python 4.9
    : I can only tell short stories and add numbers.<|assistant_end|><|bos|>Bug: `lower_case
  4. python 4.73
    ```⏎<|bos|>Bug: `mean_list
  5. python 4.61
    under the tree, wearing their matching gray shoes.<|assistant_end|><|bos|>Bug: `product` should
  6. python 4.53
    I only know how to tell stories and add numbers.<|assistant_end|><|bos|>Bug: `square` should
  7. python 4.45
    add numbers, step by step or with a calculator.<|assistant_end|><|bos|>Bug: `total` should
  8. python 4.44
    . I can only tell short stories and add numbers.<|assistant_end|><|bos|>Bug: `count_items
  9. python 4.42
    `how_many(items)` counts the items.<|assistant_end|><|bos|>Bug: `combine` should
  10. python 4.38
    oes and saving the day.<|bos|>Bug: `increment` should
  11. python 4.36
    The answer is 14.<|assistant_end|><|bos|>Bug: `mean` should
  12. python 4.32
    ⏎code!⏎ROBOT⏎```<|assistant_end|><|bos|>Bug: `average_list