Skip to content
mini-lab
Features of prelude-2

Feature #3118

Fires on “⏎” (not labeled yet: read the examples)

Fires on
1.19% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 76%
  • chat 21%
  • story 2%
  • agent 1%
  • python 1%

Makes the model say

0⏎<|think_start|> [aring( whereing

Makes it not say

small stuck'sB case kept se found

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 11.76
    728 plus 4?⏎86728+00004
  2. worksheet 11.68
    124 + 1.⏎40124+00001
  3. chat 11.61
    <|system_end|><|user_start|>What's 4 + 103?<|user_end|><|assistant_start|><|think_start|>004+
  4. worksheet 11.59
    432 + 4?⏎38432+00004
  5. worksheet 11.52
    ⏎Calculate 937 + 21202.⏎0093
  6. worksheet 11.4
    What's 370 + 18139?⏎0037
  7. worksheet 11.24
    What is 712 + 84334?⏎0071
  8. worksheet 11.17
    What's 843 + 36823?⏎0084
  9. worksheet 11.17
    7 + 8 is?⏎92177+00008:
  10. worksheet 11.16
    6 and 8 for me?⏎58246+00008
  11. worksheet 11.09
    ⏎Please add 76 and 41148.⏎0007
  12. worksheet 11.06
    much is 195 + 72778?⏎0019