Skip to content
mini-lab
Features of prelude-2

Feature #922

Fires on “,” (not labeled yet: read the examples)

Fires on
1.87% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 52%
  • chat 26%
  • python 13%
  • agent 7%
  • story 1%

Makes the model say

but1.<|bos|> ⏎ example?

Makes it not say

([ Python "!" importCreate blewpath))

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 2.17
    <|assistant_start|><|think_start|>90+86: 0+6=6, 6⏎9
  2. chat 2.15
    4⏎37+01: 7+1
  3. python 2.14
    9, 8]) == 8⏎assert tail([2, 0,
  4. chat 2.11
    4 plus 41?<|user_end|><|assistant_start|><|think_start|>44+41: 4+1
  5. python 2.11
    ` returns the number of items. For example, `count([4, 0,
  6. worksheet 2.09
    6+03: 6+3
  7. python 2.09
    return items[-1]⏎⏎⏎print(has_item([8, 8,
  8. python 2.05
    the average of nums. For example, `mean_list([8, 1,
  9. python 2.03
    3, 5]) == 6⏎assert last([5, 1,
  10. python 2.02
    ⏎from core import first, smallest⏎⏎print(first([4, 3,
  11. worksheet 2.02
    ?⏎00+46: 0+6=6, 6⏎0
  12. worksheet 2.02
    258+0015: 8+5