Skip to content
mini-lab
Features of prelude-2

Feature #1309

Fires on “ but” (not labeled yet: read the examples)

Fires on
0.45% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 47%
  • python 35%
  • chat 14%
  • agent 3%
  • worksheet 0%

Makes the model say

it one there ItOne sun One its

Makes it not say

TheyTheyif joinvowelsjsonhow how

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 5.63
    and down, having lots of fun. They played all evening until the sun went down
  2. python 4.98
    ` should return the average of a and b, but it has `return
  3. python 4.88
    Bug: `mean` should return the average of a and b, but it has `return
  4. python 4.76
    : `smaller` should return the smaller of a and b, but it has `if
  5. python 4.76
    Bug: `mean_list` should return the average of nums, but it has `return
  6. python 4.72
    <|bos|>Bug: `add` should add a and b, but it has `return
  7. python 4.7
    ⏎⏎Bug: `fact` should return the factorial of n, but it has `result
  8. python 4.69
    .<|assistant_end|><|bos|>Bug: `add` should add a and b, but it has `return
  9. python 4.69
    ⏎Bug: `vowels` should count the vowels in s, but it has `k
  10. python 4.68
    Bug: `average_list` should return the average of nums, but it has `return
  11. python 4.68
    <|assistant_end|><|bos|>Bug: `vowels` should count the vowels in s, but it has `if
  12. python 4.64
    ⏎Bug: `sum_two` should add a and b, but it has `return