Skip to content
mini-lab
Features of prelude-2

Feature #3291

Fires on “imes” (not labeled yet: read the examples)

Fires on
0.72% of tokens
Mostly in
python
Layer
after block 4

Where it fires

  • python 33%
  • agent 24%
  • story 21%
  • chat 20%
  • worksheet 2%

Makes the model say

ed wass help past saw sees looked

Makes it not say

⏎ my! forgot forgetThank gone whole

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. python 2.95
    ⏎⏎print(echo("tiger", 2))⏎print(bigger(7,
  2. python 2.86
    even⏎⏎print(is_odd(6))⏎print(even(2))⏎
  3. python 2.83
    , even⏎⏎print(even(4))⏎print(times(12,
  4. python 2.82
    nums)⏎⏎⏎print(odd(6))⏎print(times(9,
  5. python 2.81
    ⏎⏎print(add_one(12))⏎print(product(5,
  6. python 2.81
    6⏎print(larger(9, 7))⏎print(sub_one(COUNT
  7. python 2.78
    ⏎print(echo("music", 2))⏎print(times(8,
  8. python 2.75
    decrement⏎⏎print(decrement(1))⏎print(increment(7))⏎
  9. python 2.75
    , cube⏎⏎print(cube(9))⏎print(minus(4,
  10. story 2.7
    can I help you today?<|assistant_end|><|bos|>Once upon a time, in a tidy little farm,
  11. python 2.69
    = 12⏎print(twice(8))⏎print(previous(LIMIT))⏎
  12. story 2.67
    can I help you today?<|assistant_end|><|bos|>Once upon a time, in a small town, there