Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #2514

Fires on “ ” (not labeled yet: read the examples)

Fires on
0.75% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 69%
  • chat 26%
  • agent 4%
  • story 1%
  • python 0%

Makes the model say

.( he good she do!"

Makes it not say

txt had<|think_start|>}emembervalue "!" python

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 3.31
    59+01: 9+1=10, 0⏎5+
  2. worksheet 3.21
    3+679: 3+9=12, 299⏎
  3. chat 3.16
    7+989: 7+9=16, 6⏎41
  4. chat 3.15
    9+639: 9+9=18, 8⏎00
  5. chat 3.1
    6+748: 6+8=14, 4⏎00
  6. chat 3.08
    +94: 7+4+1=12, 27⏎0
  7. chat 3.07
    +98: 1+8+1=10, 06⏎4
  8. worksheet 3.07
    6+399: 6+9=15, 5⏎19
  9. worksheet 3.06
    +19: 0+9+1=10, 01⏎9
  10. worksheet 3.05
    +8043: 9+3=12, 29⏎0
  11. worksheet 3.04
    09+93: 9+3=12, 2⏎0+
  12. chat 3.04
    0+63: 0+3+1=4, 46⏎0