Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #2296

Fires on “'s” (not labeled yet: read the examples)

Fires on
0.54% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 56%
  • worksheet 16%
  • chat 14%
  • agent 9%
  • python 5%

Makes the model say

ground absoluteabsolutemyled both first thinks

Makes it not say

a story = import the == let The

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 3.66
    <|system_end|><|user_start|>Hey, what's 8 plus
  2. chat 3.52
    mom and dad flying high in the sky.<|assistant_end|><|user_start|>Hey, what's 29 plus
  3. worksheet 3.32
    252 = 261.⏎Hey, what's 4 plus
  4. worksheet 3.31
    79 = 10564.⏎Hey, what's 281
  5. chat 3.3
    <|assistant_start|>The answer is 885.<|assistant_end|><|user_start|>Hey, what's 37 plus
  6. chat 3.27
    <|assistant_start|>The answer is 152.<|assistant_end|><|user_start|>Hey, what's 423
  7. chat 3.26
    <|assistant_start|>The answer is 479.<|assistant_end|><|user_start|>Hey, what's 722
  8. chat 3.25
    s!<|user_end|><|assistant_start|>Happy to help!<|assistant_end|><|user_start|>Hey, what's 421
  9. worksheet 3.23
    24 = 68132.⏎Hey, what's 424
  10. chat 3.21
    .<|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>Hey, what's 240
  11. worksheet 3.2
    1 = 40379.⏎Hey, what's 405
  12. chat 3.18
    and played with the ball all day long.<|bos|><|user_start|>Hey, what's 8 plus