Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #781

Fires on “,” (not labeled yet: read the examples)

Fires on
0.26% of tokens
Mostly in
python
Layer
after block 4

Where it fires

  • python 35%
  • story 33%
  • agent 23%
  • chat 7%
  • worksheet 2%

Makes the model say

back and,7 twoFrom double new

Makes it not say

<|think_end|> "!"`.<|arg|><|tool_end|>`,oldString calculator<|assistant_end|>

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. python 2.54
    # test_arith.py⏎from arith import positive, smaller, product⏎⏎assert
  2. python 2.52
    number_utils.py⏎from number_utils import smaller, plus, is_odd⏎
  3. python 2.48
    <|bos|># test_words.py⏎from words import exclaim, echo, last_letter⏎
  4. python 2.3
    test_lists.py⏎from lists import has_item, biggest, last⏎⏎assert
  5. python 2.28
    ⏎# test_listlib.py⏎from listlib import includes, first, average_list⏎
  6. python 2.27
    number_utils.py⏎from number_utils import twice, smaller, previous⏎⏎assert
  7. python 2.18
    test_ops.py⏎from ops import sub_one, square, mean⏎⏎assert
  8. python 2.15
    ⏎# test_lists.py⏎from lists import biggest, doubled, add_all⏎
  9. python 2.14
    test_stats.py⏎from stats import keep_even, last, total⏎⏎assert
  10. python 2.1
    ⏎# test_items.py⏎from items import tail, head, double_all⏎
  11. python 2.07
    ⏎from arith import sum_up_to, lower_of, difference⏎⏎assert
  12. python 2.06
    test_utils.py⏎from utils import join_words, square, first_letter⏎