Skip to content
mini-lab
Features of prelude-2

Feature #449

Fires on “6” (not labeled yet: read the examples)

Fires on
1.36% of tokens
Mostly in
python
Layer
after block 4

Where it fires

  • python 35%
  • worksheet 23%
  • agent 20%
  • story 14%
  • chat 7%

Makes the model say

hello<|assistant_end|>opencodeThankEADME tall_ched

Makes it not say

but they# waitedu heard in cat

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. agent 2.65
    6666666666666665⏎```<|assistant_end|>
  2. python 2.59
    6666666666666665⏎assert sum
  3. python 2.47
    6666666666666665`.⏎⏎
  4. python 2.42
    , cube⏎⏎assert power(4, 3) == 64⏎assert power
  5. python 2.41
    , 2])` returns `[18,
  6. python 2.32
    squared, sub_one⏎⏎assert squared(8) == 64⏎assert squared
  7. python 2.31
    , `sum_list([1, 0, 2])` returns `3`.⏎
  8. python 2.26
    ") == "music tiger"⏎assert square(8) == 64⏎assert first
  9. python 2.25
    2) == 11⏎assert square(8) == 64⏎assert mean
  10. python 2.24
    numbers. For example, `larger(12, 7)` returns `12`.
  11. agent 2.23
    function hello that says hello to name and a function final_letter that returns the last letter of
  12. agent 2.23
    a function mean(a, b) in helpers.py that returns the average of a