Skip to content
mini-lab
Features of prelude-2

Feature #3795

Fires on “:” (not labeled yet: read the examples)

Fires on
1.15% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 67%
  • worksheet 23%
  • chat 6%
  • story 3%
  • python 1%

Makes the model say

allexpressionnumsoldString never<|arg|>path That

Makes it not say

to for?# round?" morning soft

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. agent 3.88
    return a * b⏎3: ⏎4: ⏎5: def square(x
  2. agent 3.85
    : ⏎5: def sum_list(nums):⏎6: result =
  3. agent 3.85
    b⏎5: ⏎6: ⏎7:
  4. agent 3.83
    ⏎4: ⏎5: def doubled(nums):⏎6: return [n
  5. agent 3.81
    : ⏎5: def average_list(nums):⏎6: return sum(
  6. agent 3.78
    ⏎4: ⏎5: def last(items):⏎6: return items[-
  7. agent 3.77
    return s + "!"⏎3: ⏎4: ⏎5: def loud(s
  8. agent 3.76
    )⏎3: ⏎4: ⏎5: def final_letter
  9. agent 3.75
    * x * x⏎3: ⏎4: ⏎5: def divides(a
  10. agent 3.73
    ]⏎3: ⏎4: ⏎5: def last_letter
  11. agent 3.73
    ⏎4: ⏎5: def factorial(n):⏎6: result =
  12. agent 3.72
    b == 0⏎3: ⏎4: ⏎5: def sum_up