Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #346

Fires on “ it” (not labeled yet: read the examples)

Fires on
0.37% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 48%
  • python 29%
  • story 17%
  • chat 5%
  • worksheet 0%

Makes the model say

For import fly atedof was has

Makes it not say

littleingallonlynumberillit(-

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. python 4.42
    : `average_list` should return the average of nums, but it has `return sum
  2. python 4.34
    Bug: `exclaim` should add an exclamation mark to s, but it has `return s
  3. python 4.3
    <|assistant_end|><|bos|>Bug: `add` should add a and b, but it has `return a
  4. python 4.3
    `difference` should subtract b from a, but it has `return a
  5. python 4.28
    : `average_list` should return the average of nums, but it has `return sum
  6. python 4.28
    Bug: `initial` should return the first letter of s, but it has `return s
  7. python 4.27
    1.<|assistant_end|><|bos|>Bug: `flip` should reverse s, but it has `return s
  8. python 4.23
    <|bos|>Bug: `vowels` should count the vowels in s, but it has `if c
  9. python 4.22
    : `mean` should return the average of a and b, but it has `return (
  10. python 4.21
    : `average_list` should return the average of nums, but it has `return sum
  11. python 4.21
    <|bos|>Bug: `minus` should subtract b from a, but it has `return b
  12. python 4.2
    : `power` should return a to the power of b, but it has `return a