Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #3844

Fires on “ `” (not labeled yet: read the examples)

Fires on
0.77% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 59%
  • python 36%
  • story 4%
  • chat 1%
  • worksheet 0%

Makes the model say

Soid steput openedd carefullyschema

Makes it not say

<|bos|> park import They place theirBug⏎

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. python 4.93
    <|bos|>Bug: `max_of`
  2. python 4.93
    <|bos|>Bug: `add` should add
  3. python 4.81
    ```⏎<|bos|>Bug: `mean_list`
  4. python 4.57
    ```⏎⏎Bug: `total` should add
  5. python 4.57
    oes and saving the day.<|bos|>Bug: `increment` should add
  6. python 4.56
    return x % 2 == 0⏎```⏎⏎Bug: `average` should return
  7. python 4.47
    how_many(items)` counts the items.<|assistant_end|><|bos|>Bug: `combine` should return
  8. python 4.47
    ⏎Bug: `vowels` should count
  9. python 4.47
    ⏎Bug: `exclaim` should add
  10. python 4.46
    acc = acc + i⏎ return acc⏎```⏎<|bos|>Bug: `last` should return
  11. python 4.46
    nums):⏎ return max(nums)⏎```⏎⏎Bug: `only_even`
  12. python 4.45
    (x):⏎ return x * x⏎```⏎⏎Bug: `sum_two`