Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #704

Fires on “ a” (not labeled yet: read the examples)

Fires on
0.10% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 72%
  • python 15%
  • story 7%
  • agent 5%
  • worksheet 1%

Makes the model say

)`. some dog come(a after take

Makes it not say

onereturnest made werel bestit

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 5.19
    today?<|assistant_end|><|user_start|>Goodbye!<|user_end|><|assistant_start|>Goodbye! Have a nice day.<|assistant_end|>
  2. chat 5.12
    help you today?<|assistant_end|><|user_start|>Bye<|user_end|><|assistant_start|>Goodbye! Have a nice day.<|assistant_end|>
  3. chat 4.93
    calculator.<|assistant_end|><|user_start|>Goodbye!<|user_end|><|assistant_start|>Goodbye! Have a nice day.<|assistant_end|>
  4. chat 4.81
    numbers.<|assistant_end|><|user_start|>Good night!<|user_end|><|assistant_start|>Goodbye! Have a nice day.<|assistant_end|>
  5. chat 4.79
    appy to help!<|assistant_end|><|user_start|>Bye<|user_end|><|assistant_start|>Goodbye! Have a nice day.<|assistant_end|>
  6. chat 4.75
    <|system_end|><|user_start|>See you later!<|user_end|><|assistant_start|>Goodbye! Have a nice day.<|assistant_end|>
  7. chat 4.7
    ```<|assistant_end|><|bos|><|user_start|>Good night!<|user_end|><|assistant_start|>Goodbye! Have a nice day.<|assistant_end|>
  8. chat 4.65
    numbers.<|assistant_end|><|user_start|>goodbye<|user_end|><|assistant_start|>Goodbye! Have a nice day.<|assistant_end|>
  9. chat 4.56
    add numbers.<|assistant_end|><|bos|><|user_start|>Bye<|user_end|><|assistant_start|>Goodbye! Have a nice day.<|assistant_end|>
  10. chat 4.53
    <|bos|><|user_start|>See you later!<|user_end|><|assistant_start|>Goodbye! Have a nice day.<|assistant_end|>
  11. chat 4.51
    <|bos|><|user_start|>See you later!<|user_end|><|assistant_start|>Goodbye! Have a nice day.<|assistant_end|>
  12. chat 4.5
    : calculator<|system_end|><|user_start|>Good night!<|user_end|><|assistant_start|>Goodbye! Have a nice day.<|assistant_end|>