Skip to content
mini-lab
Features of prelude-2

Feature #2449

Fires on “,” (not labeled yet: read the examples)

Fires on
1.70% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 58%
  • python 20%
  • chat 16%
  • worksheet 5%
  • story 1%

Makes the model say

ut butai I replace there rolledas

Makes it not say

⏎ boy Tim<|bos|> return`Tim?

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. python 4.66
    def includes(items, x):⏎ return
  2. python 4.65
    * 2 for n in nums]⏎⏎⏎def contains(items, x):⏎ return
  3. python 4.56
    result = result * i⏎ return result⏎⏎⏎def plus(a, b):⏎
  4. python 4.55
    (nums) / len(nums)⏎⏎⏎def contains(items, x):⏎ return
  5. python 4.53
    He was proud and ready for school.<|assistant_end|><|bos|>`contains(items, x)` checks whether
  6. python 4.49
    result = result * i⏎ return result⏎⏎⏎def repeat(s, n):⏎ return
  7. python 4.47
    ⏎def contains(items, x):⏎ return
  8. python 4.43
    x):⏎ return x > 0⏎⏎⏎def product(a, b):⏎ return
  9. python 4.36
    56.<|assistant_end|><|bos|># listlib.py⏎def includes(items, x):⏎ return
  10. python 4.35
    s):⏎ return s.upper()⏎⏎⏎def repeat(s, n):⏎ return
  11. python 4.33
    tell short stories and add numbers.<|assistant_end|><|bos|>`minus(a, b)` returns a
  12. python 4.33
    to `lib.py`.<|assistant_end|><|bos|>`has_item(items, x)` returns True