Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #271

Fires on “ I” (not labeled yet: read the examples)

Fires on
0.73% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 44%
  • story 34%
  • agent 17%
  • worksheet 3%
  • python 2%

Makes the model say

will aboutee would```): Instead I

Makes it not say

ig plusleve blew big sharedscript

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 3.92
    zil?<|user_end|><|assistant_start|>Sorry, I don't know about that. I can only tell short
  2. chat 3.64
    telephone<|user_end|><|assistant_start|>Sorry, I don't know about that. I can only tell short
  3. chat 3.56
    India<|user_end|><|assistant_start|>Sorry, I don't know about that. I can only tell short
  4. chat 3.47
    iet<|user_end|><|assistant_start|>Sorry, I don't know about that. I can only tell short
  5. chat 3.45
    in today?<|user_end|><|assistant_start|>Sorry, I don't know about that. I can only tell short
  6. chat 3.4
    uliet?<|user_end|><|assistant_start|>Sorry, I don't know about that. I can only tell short
  7. chat 3.34
    in the world<|user_end|><|assistant_start|>Sorry, I don't know about that. I can only tell short
  8. story 3.32
    "We are sorry, mom. We did not think about Spot. We will share with him
  9. chat 3.3
    ores.<|user_end|><|assistant_start|>Sorry, I don't know about that. I can only tell short
  10. chat 3.3
    zil.<|user_end|><|assistant_start|>Sorry, I don't know about that. I can only tell short
  11. chat 3.27
    space.<|user_end|><|assistant_start|>Sorry, I don't know about that. I can only tell short
  12. story 3.26
    I'm sorry. I didn't know it was her baby doll. I thought it was a