Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #348

Fires on “7” (not labeled yet: read the examples)

Fires on
1.34% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 72%
  • chat 20%
  • story 5%
  • python 3%
  • agent 0%

Makes the model say

⏎ went now were lived head could saw

Makes it not say

=**/*.))]))keep checkchapp checks

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 3.44
    323+0022: 3+2=5, 57
  2. worksheet 3.37
    17+32580: 7+0=7, 7⏎
  3. worksheet 3.35
    701+0006: 1+6=7, 79
  4. worksheet 3.32
    ⏎003+276: 3+6=9, 98
  5. worksheet 3.3
    037+0000: 7+0=7, 79
  6. worksheet 3.29
    656+0000: 6+0=6, 66
  7. chat 3.26
    <|think_start|>036+920: 6+0=6, 6⏎
  8. worksheet 3.23
    661+6402: 1+2=3, 3⏎
  9. worksheet 3.22
    64⏎66+00: 6+0=6, 62
  10. worksheet 3.21
    ⏎464+233: 4+3=7, 7⏎
  11. worksheet 3.2
    1+736: 1+6=7, 75
  12. worksheet 3.18
    0+0003: 0+3=3, 3⏎