Skip to content
mini-lab
Features of prelude-2

Feature #319

Fires on “utils” (not labeled yet: read the examples)

Fires on
1.13% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 82%
  • python 8%
  • chat 5%
  • story 3%
  • worksheet 1%

Makes the model say

ground")) " What)) what love

Makes it not say

todayFixedGood return Sols outsidecount

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. python 2.32
    ⏎# test_number_utils.py⏎from number_utils import smaller, plus
  2. python 2.32
    <|assistant_end|><|bos|># test_number_utils.py⏎from number_utils import lower_of
  3. python 2.29
    ⏎⏎# test_number_utils.py⏎from number_utils import cubed, absolute
  4. agent 2.27
    _number_utils.py<|arg|>oldString
  5. python 2.26
    .<|bos|># test_number_utils.py⏎from number_utils import twice, smaller
  6. python 2.12
    ⏎⏎# test_number_utils.py⏎from number_utils import sum_up
  7. python 2.11
    ⏎⏎# test_number_utils.py⏎from number_utils import square⏎⏎
  8. python 2.09
    ⏎⏎# test_number_utils.py⏎from number_utils import magnitude, lower
  9. python 2.07
    ⏎⏎# test_number_utils.py⏎from number_utils import is_divisible
  10. python 2.03
    script.py⏎from lib import contains, raise_to⏎from ops import sub_one
  11. python 2.0
    ⏎⏎# test_number_utils.py⏎from number_utils import odd, sub
  12. python 1.96
    py⏎from helpers import max_of, decrement⏎from number_utils import abs_value