Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #965

Fires on “ ” (not labeled yet: read the examples)

Fires on
1.29% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 42%
  • python 29%
  • worksheet 14%
  • story 8%
  • chat 7%

Makes the model say

was were also all knew everything1

Makes it not say

functionsjsonhttps<|user_start|>```A =has

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. python 7.67
    [10, 6, 14, 2, 6]⏎2
  2. python 7.41
    py⏎9⏎[2, 0, 16, 4]⏎<|bos|>
  3. python 7.14
    ])⏎[16, 16, 12, 8]⏎⏎
  4. python 7.13
    8])` returns `[16, 0, 8, 16]`.⏎
  5. python 7.1
    ])` returns `[16, 10, 16, 16]`.⏎
  6. python 7.09
    2])⏎[2, 8, 18, 4]⏎⏎
  7. python 7.03
    14, 10, 10, 2, 10]⏎
  8. python 6.9
    ⏎[2, 8, 18, 0, 4]⏎True
  9. python 6.85
    [6, 10, 18, 6, 6]⏎assert
  10. python 6.84
    [16, 18, 2, 6, 14]⏎
  11. python 6.76
    8]) == [18, 10, 8, 16]⏎
  12. python 6.68
    0]) == [10, 10, 4, 0]⏎assert