Skip to content
mini-lab
Features of prelude-2

Feature #277

Fires on “ has” (not labeled yet: read the examples)

Fires on
0.30% of tokens
Mostly in
python
Layer
after block 4

Where it fires

  • python 63%
  • chat 20%
  • story 10%
  • agent 7%
  • worksheet 0%

Makes the model say

<|tool_call_start|><|system_start|> Inside<|user_start|> calculator listain<|assistant_end|>

Makes it not say

theyBut that swam was. himself They

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. python 5.74
    Bug: `vowels` should count the vowels in s, but it has `k = k
  2. python 5.73
    max_of` should return the bigger of two numbers, but it has `return a`.
  3. python 5.67
    : `sub_one` should subtract one from x, but it has `return x +
  4. python 5.62
    difference` should subtract b from a, but it has `return a +
  5. python 5.61
    ⏎Bug: `subtract` should subtract b from a, but it has `return b -
  6. python 5.61
    Bug: `fact` should return the factorial of n, but it has `result = result
  7. python 5.59
    Bug: `doubled` should double every number in nums, but it has `return [n
  8. python 5.56
    Bug: `includes` should check whether items contains x, but it has `return x not
  9. python 5.55
    : `doubled` should return every number of nums doubled, but it has `return [n
  10. python 5.55
    `only_even` should keep only the even numbers, but it has `return [n
  11. python 5.52
    Bug: `fact` should return the factorial of n, but it has `result =
  12. python 5.51
    difference` should subtract b from a, but it has `return b -