Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #2369

Fires on “ a” (not labeled yet: read the examples)

Fires on
0.46% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 41%
  • worksheet 24%
  • agent 17%
  • python 14%
  • story 4%

Makes the model say

⏎⏎ tests://⏎ apepytest project "!"`.

Makes it not say

was about very important Sara had loved and

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 2.66
    help you today?<|assistant_end|><|user_start|>Bye<|user_end|><|assistant_start|>Goodbye! Have a nice day.<|assistant_end|>
  2. chat 2.59
    <|system_start|>Answer in one short sentence.<|system_end|><|user_start|>I want a story about a boat
  3. chat 2.58
    calculator.<|assistant_end|><|user_start|>Goodbye!<|user_end|><|assistant_start|>Goodbye! Have a nice day.<|assistant_end|>
  4. chat 2.5
    appy to help!<|assistant_end|><|user_start|>Bye<|user_end|><|assistant_start|>Goodbye! Have a nice day.<|assistant_end|>
  5. chat 2.48
    under a tree.<|assistant_end|><|user_start|>Bye<|user_end|><|assistant_start|>Goodbye! Have a nice day.<|assistant_end|>
  6. chat 2.48
    <|system_end|><|user_start|>See you later!<|user_end|><|assistant_start|>Goodbye! Have a nice day.<|assistant_end|>
  7. chat 2.46
    today?<|assistant_end|><|user_start|>Goodbye!<|user_end|><|assistant_start|>Goodbye! Have a nice day.<|assistant_end|>
  8. chat 2.45
    : calculator<|system_end|><|user_start|>Good night!<|user_end|><|assistant_start|>Goodbye! Have a nice day.<|assistant_end|>
  9. chat 2.44
    add numbers.<|assistant_end|><|bos|><|user_start|>Bye<|user_end|><|assistant_start|>Goodbye! Have a nice day.<|assistant_end|>
  10. chat 2.42
    : calculator<|system_end|><|user_start|>Good night!<|user_end|><|assistant_start|>Goodbye! Have a nice day.<|assistant_end|>
  11. chat 2.41
    numbers.<|assistant_end|><|user_start|>Good night!<|user_end|><|assistant_start|>Goodbye! Have a nice day.<|assistant_end|>
  12. chat 2.41
    ```<|assistant_end|><|bos|><|user_start|>Good night!<|user_end|><|assistant_start|>Goodbye! Have a nice day.<|assistant_end|>