Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #1821

Fires on “'s” (not labeled yet: read the examples)

Fires on
0.37% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 49%
  • story 23%
  • chat 18%
  • worksheet 8%
  • python 1%

Makes the model say

everywhere perfectood We He usnek

Makes it not say

_`2ockedultipl says +of

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 4.21
    2497 = 4933.<|bos|>What's 370
  2. worksheet 4.13
    . Now Tim has 13926 toys.⏎What's 25 +
  3. worksheet 4.11
    : I can only tell short stories and add numbers.<|assistant_end|><|bos|>What's 555
  4. worksheet 4.1
    made their planet a fun and happy place to be.<|assistant_end|><|bos|>What's 781
  5. chat 4.09
    good friends.<|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>What's 100
  6. worksheet 4.09
    4⏎So 0 + 4 = 4.<|bos|>What's 987
  7. worksheet 4.07
    + 690 = 1183.⏎What's 200
  8. worksheet 4.06
    8740 = 8747.⏎What's 651
  9. worksheet 4.05
    + 980 = 1963.⏎What's 106
  10. worksheet 4.04
    5 + 61 = 7936.<|bos|>What's 404
  11. worksheet 4.04
    459 = 51854.⏎What's 8 +
  12. chat 4.03
    there was a pink car. The pink car loved to zoom all around the town.<|assistant_end|>