Skip to content
mini-lab
Features of prelude-2

Feature #3513

Fires on “ a” (not labeled yet: read the examples)

Fires on
0.74% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 70%
  • story 19%
  • agent 8%
  • worksheet 2%
  • python 2%

Makes the model say

a and happy brave fun an people adventure

Makes it not say

RenamedHey=**/*.expression{ checkllo`,

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 7.23
    initial(s)`.<|assistant_end|><|bos|><|user_start|>Can you tell me a story about a dragon?<|user_end|><|assistant_start|>
  2. chat 7.22
    <|user_start|>Can you tell me a story about a car?<|user_end|><|assistant_start|>
  3. chat 7.21
    <|system_start|>Answer in one short sentence.<|system_end|><|user_start|>I want a story about a boat!<|user_end|><|assistant_start|>
  4. chat 7.2
    in one short sentence.<|system_end|><|user_start|>Can you tell me a story about a bird?<|user_end|><|assistant_start|>
  5. chat 7.04
    in one short sentence.<|system_end|><|user_start|>Can you tell me a story about a fish?<|user_end|><|assistant_start|>
  6. chat 7.0
    was jumping from tree to tree.<|assistant_end|><|user_start|>I want a story about a princess!<|user_end|><|assistant_start|>
  7. chat 6.97
    in one short sentence.<|system_end|><|user_start|>Can you tell me a story about a bird?<|user_end|><|assistant_start|>
  8. chat 6.92
    tests pass now.<|assistant_end|><|bos|><|user_start|>Can you tell me a story about a car?<|user_end|><|assistant_start|>
  9. chat 6.89
    tell short stories and add numbers.<|assistant_end|><|user_start|>I want a story about a cat!<|user_end|><|assistant_start|>
  10. chat 6.89
    are a helpful assistant.<|system_end|><|user_start|>Can you tell me a story about a tree?<|user_end|><|assistant_start|>
  11. chat 6.88
    for another story soon.<|assistant_end|><|bos|><|user_start|>I want a story about a dog!<|user_end|><|assistant_start|>
  12. chat 6.87
    <|system_start|>Answer in one short sentence.<|system_end|><|user_start|>Tell me a story about a cat.<|user_end|><|assistant_start|>