Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #3271

Fires on “ so” (not labeled yet: read the examples)

Fires on
0.61% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 65%
  • worksheet 20%
  • chat 11%
  • agent 3%
  • python 1%

Makes the model say

happyy excited played play beautifularingh

Makes it not say

: numsten], too adds divisible both

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 10.83
    so proud that she was
  2. story 10.83
    so much fun! Then
  3. story 10.83
    so it flew fast and
  4. chat 10.83
    so yummy! Bob wanted
  5. story 10.83
    so he just put it
  6. story 8.46
    was so lovely and strong.
  7. story 8.46
    was so thankful to the prince
  8. story 8.46
    was so excited and waited patient
  9. story 8.32
    ated, so her brother added
  10. story 7.59
    oyster was so happy. Now,
  11. story 7.49
    only saw the ceiling and the bandages. They were sad and sore.<|bos|>Once
  12. story 7.03
    luffy was so happy and it p