Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #2587

Fires on “ +” (not labeled yet: read the examples)

Fires on
0.37% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 80%
  • chat 14%
  • story 3%
  • agent 2%
  • python 0%

Makes the model say

and butWprint even printselyNo

Makes it not say

Sara<|assistant_end|> t0tomean * seen

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 4.65
    10 = 79.⏎68641 + 356
  2. story 4.58
    the park and in the house. One day, they decided to play hide and seek. Lily
  3. worksheet 4.54
    55 is 100.⏎44368 + 983
  4. story 4.42
    in the park with their gray dog, Max. They like to play hide and seek with Max
  5. story 4.34
    and they started to play an interesting game.⏎"Let's play hide and seek," one
  6. worksheet 4.33
    = 72876.⏎89192 + 384
  7. worksheet 4.29
    = 92304.⏎45564 + 848
  8. worksheet 4.26
    8 = 43109.⏎5167 + 15 =
  9. worksheet 4.24
    65 = 7375.⏎6865 + 887
  10. worksheet 4.24
    94 = 9593⏎76953 + 21 =
  11. worksheet 4.21
    3 = 1255.⏎78140 + 640
  12. worksheet 4.2
    8 equals 7463.⏎40797 + 6 =