Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #2857

Fires on “0” (not labeled yet: read the examples)

Fires on
0.28% of tokens
Mostly in
python
Layer
after block 4

Where it fires

  • python 39%
  • agent 25%
  • worksheet 13%
  • story 13%
  • chat 10%

Makes the model say

<|system_start|> new breathschemaStart rever<|user_end|>

Makes it not say

were2⏎ sunOne hopped felt because

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 2.47
    0+2=2
  2. chat 2.47
    0 and 0.
  3. agent 2.47
    0]⏎```<|assistant_end|>
  4. agent 2.47
    0, 0]))
  5. agent 2.47
    0, 3]`
  6. worksheet 2.47
    0+8=8
  7. chat 2.47
    0.<|user_end|><|assistant_start|><|think_start|>
  8. worksheet 2.47
    0 + 46
  9. python 2.3
    ` should return the number of vowels in s, but it has `if c in "aei
  10. python 2.29
    ` should return the smaller of a and b, but it has `if a > b:`.
  11. python 2.22
    ` should return the smaller of a and b, but it has `if a > b:`.
  12. python 2.22
    ` should return the smaller of a and b, but it has `if a > b:`.