Skip to content
mini-lab
Features of prelude-2

Feature #1679

Fires on “ n” (not labeled yet: read the examples)

Fires on
0.44% of tokens
Mostly in
python
Layer
after block 4

Where it fires

  • python 30%
  • agent 26%
  • chat 25%
  • story 14%
  • worksheet 5%

Makes the model say

listed first<|assistant_end|> barked their<|system_end|>re

Makes it not say

Bug hold# happen am in Just look

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. python 3.84
    ** b⏎```⏎⏎Bug: `whisper` should return s in lower case, but
  2. python 3.7
    <|think_end|>816<|assistant_end|><|bos|>Bug: `echo` should repeat s n times, but it
  3. python 3.7
    + b⏎```⏎⏎Bug: `repeat` should repeat s n times, but it
  4. python 3.67
    `"hellohellohello"`.⏎⏎`shout(s)` makes s upper case.⏎⏎
  5. python 3.65
    ice.<|bos|>`repeat(s, n)` repeats s n times.⏎⏎
  6. python 3.6
    return s.lower()⏎```⏎⏎`whisper` returns s in lower case. For
  7. python 3.59
    "`.⏎⏎`repeat(s, n)` repeats s n times.⏎⏎
  8. python 3.5
    ```⏎⏎Bug: `upper_case` should return s in upper case, but it
  9. python 3.5
    0]⏎⏎`lower_case(s)` returns s in lower case.⏎
  10. python 3.49
    numbers.<|assistant_end|><|bos|>Bug: `lower_case` should return s in lower case, but
  11. python 3.49
    "`.⏎⏎`echo(s, n)` repeats s n times.⏎⏎
  12. python 3.48
    .<|assistant_end|><|bos|>`repeat(s, n)` repeats s n times.⏎⏎