Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #515

Fires on “ long” (not labeled yet: read the examples)

Fires on
0.76% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 35%
  • agent 29%
  • chat 18%
  • worksheet 11%
  • python 8%

Makes the model say

, becauseg scaredness sound d hard

Makes it not say

TheypyThey python another them returnsOne

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 2.4
    use the calculator.<|system_end|>
  2. story 2.3
    a great adventure because of the
  3. story 2.28
    an elderly lady, who loved
  4. story 2.17
    a bad dream. She saw
  5. story 2.15
    long nap.<|bos|>```
  6. story 2.15
    long.⏎Soon,
  7. chat 2.09
    Answer with the number only.<|system_end|><|user_start|>Find the sum of 1 and 12.
  8. chat 2.09
    a fair princess. She lived
  9. worksheet 2.09
    6656.⏎Anna had 18624 toys and found
  10. chat 2.08
    the bitter lemon and climbed into
  11. worksheet 2.01
    86680.⏎Tim has 21523 stickers. Tim gets
  12. worksheet 2.0
    5 = 58.⏎Mia had 23771 shells and found