Skip to content
mini-lab
Features of prelude-2

Feature #2977

Fires on “last” (not labeled yet: read the examples)

Fires on
0.41% of tokens
Mostly in
python
Layer
after block 4

Where it fires

  • python 62%
  • story 13%
  • agent 13%
  • worksheet 6%
  • chat 6%

Makes the model say

xbiggestOnce` bigger worry fasterse

Makes it not say

had has haveThisers things back core

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. python 3.19
    ):⏎ return max(nums)⏎```⏎⏎Bug: `first_letter` should
  2. python 3.16
    ):⏎ return s[0]⏎```⏎⏎Bug: `last` should return the
  3. python 3.11
    nums) / len(nums)⏎```⏎⏎Bug: `first` should return the
  4. python 3.08
    ):⏎ return s[0]⏎```⏎⏎Bug: `last_letter` should
  5. python 3.07
    can only tell short stories and add numbers.<|assistant_end|><|bos|>Bug: `last_letter` should
  6. python 3.06
    ):⏎ return s[-1]⏎```⏎⏎Bug: `first` should return the
  7. python 3.01
    x):⏎ return x * x⏎```⏎⏎Bug: `last_letter` should
  8. python 2.97
    x):⏎ return x in items⏎```⏎⏎Bug: `last` should return the
  9. python 2.97
    k + 1⏎ return k⏎```⏎⏎Bug: `first_letter` should
  10. python 2.95
    = acc + i⏎ return acc⏎```⏎<|bos|>Bug: `last` should return the
  11. python 2.93
    ):⏎ return x > 0⏎```⏎⏎Bug: `last`
  12. python 2.91
    ):⏎ return items[-1]⏎```⏎⏎Bug: `first` should return the