Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #66

Fires on “ you” (not labeled yet: read the examples)

Fires on
0.51% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 49%
  • chat 34%
  • agent 12%
  • python 3%
  • worksheet 1%

Makes the model say

help helped teach coursehead " friend sound

Makes it not say

:ight⏎ minnamer<|assistant_end|>?

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 4.22
    I'm sorry I ran away. I just got scared. Will you forgive me?"⏎
  2. story 4.2
    ask her friend Candy for help.⏎"Candy, can you teach me why I
  3. story 4.18
    boy said, "Hi there parrot, can you whistle for me?"
  4. chat 4.13
    .<|assistant_end|><|bos|><|user_start|>Great, thanks!<|user_end|><|assistant_start|>Happy to help!<|assistant_end|><|user_start|>
  5. agent 4.11
    . Can you fix the code?
  6. chat 4.08
    in this project.<|assistant_end|><|bos|><|user_start|>thanks<|user_end|><|assistant_start|>Happy to help!<|assistant_end|><|user_start|>
  7. story 4.05
    Tim saw his friend, Sam, walking by. "Sam, can you help me move this
  8. story 3.99
    do?" The cat thought for
  9. story 3.97
    friend, Tom. He was a strong man. "Tom, can you help me? There
  10. story 3.95
    The oyster said, "Hi, boat! I am lost. Can you help me find my
  11. story 3.95
    his friend Sam for help.⏎Tim said, "Sam, can you help me replace the
  12. story 3.89
    from the tree, but the ice is too slippery. Can you help me?" The