Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #1407

Fires on “ have” (not labeled yet: read the examples)

Fires on
0.11% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 35%
  • worksheet 35%
  • story 17%
  • python 10%
  • agent 4%

Makes the model say

there equals now upled done here8

Makes it not say

Once ideahingnitude Butesse vowels

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 5.07
    stickers. Tim gets 6 more stickers. How many stickers does Tim have now?<|user_end|><|assistant_start|>
  2. chat 4.97
    apples. Mia gets 4 more apples. How many apples does Mia have now?<|user_end|><|assistant_start|>
  3. chat 4.95
    shells. Tom gets 9 more shells. How many shells does Tom have now?<|user_end|><|assistant_start|>
  4. chat 4.86
    . Tim gets 76 more cookies. How many cookies does Tim have now?<|user_end|><|assistant_start|>
  5. worksheet 4.84
    books. Sue gets 7 more books. How many books does Sue have now?⏎0
  6. chat 4.83
    Tim gets 186 more cookies. How many cookies does Tim have now?<|user_end|><|assistant_start|>
  7. chat 4.83
    stickers. Mia gets 2 more stickers. How many stickers does Mia have now?<|user_end|><|assistant_start|>
  8. chat 4.82
    shells. Tim gets 6 more shells. How many shells does Tim have now?<|user_end|><|assistant_start|>
  9. chat 4.8
    apples. Anna gets 8 more apples. How many apples does Anna have now?<|user_end|><|assistant_start|>
  10. chat 4.8
    cookies. Sue gets 4 more cookies. How many cookies does Sue have now?<|user_end|><|assistant_start|>
  11. worksheet 4.79
    cookies. Max gets 1 more cookies. How many cookies does Max have now?⏎6
  12. worksheet 4.75
    stickers. Mia gets 4 more stickers. How many stickers does Mia have now?⏎0