Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #1710

Fires on “,” (not labeled yet: read the examples)

Fires on
0.73% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 62%
  • chat 28%
  • python 5%
  • agent 4%
  • story 2%

Makes the model say

rightorli_ that hello That co

Makes it not say

upper") times tests x teeth":ze

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 2.07
    I'm a tiny language model: I
  2. chat 2.07
    I'm a tiny model: I can
  3. chat 1.82
    45+006: 5+6=11, 1⏎1
  4. python 1.81
    , 5, 9, 1, 4]) == 9⏎assert biggest
  5. worksheet 1.79
    7+0004: 7+4=11, 1⏎8
  6. python 1.78
    largest([9, 6, 0, 1])` returns `9`.⏎<|bos|>
  7. worksheet 1.77
    7+0004: 7+4=11, 1⏎6
  8. worksheet 1.76
    +00084: 7+4=11, 1⏎5
  9. chat 1.76
    101+010: 1+0=1, 1⏎1
  10. worksheet 1.75
    +85503: 8+3=11, 1⏎0
  11. worksheet 1.74
    0014: 6+4+1=11, 11⏎
  12. chat 1.73
    <|think_start|>15+06: 5+6=11, 1⏎1