Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #3180

Fires on “ a” (not labeled yet: read the examples)

Fires on
0.70% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 72%
  • agent 12%
  • story 8%
  • python 5%
  • worksheet 4%

Makes the model say

story me name stories numbers tr prelude calculator

Makes it not say

haveb home has next darkWhere check

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 5.86
    <|user_start|>Can you tell me a story about a car
  2. chat 5.57
    to play with the other boats.<|assistant_end|><|user_start|>Can you tell me a story?<|user_end|><|assistant_start|>
  3. chat 5.53
    The answer is 815.<|assistant_end|><|user_start|>Can you tell me a story about the sea
  4. chat 5.43
    ` with `initial(s)`.<|assistant_end|><|bos|><|user_start|>Can you tell me a story about a dragon
  5. chat 5.42
    <|bos|><|system_start|>Answer in one short sentence.<|system_end|><|user_start|>Can you tell me a story about a bird
  6. chat 5.37
    <|bos|><|system_start|>Answer in one short sentence.<|system_end|><|user_start|>Can you tell me a story?<|user_end|><|assistant_start|>
  7. chat 5.3
    return x + 1⏎```⏎<|bos|><|user_start|>Can you tell me a story?<|user_end|><|assistant_start|>
  8. chat 5.29
    <|bos|><|system_start|>You are a helpful assistant.<|system_end|><|user_start|>Can you tell me a story?<|user_end|><|assistant_start|>
  9. chat 5.29
    The answer is 10.<|assistant_end|><|bos|><|user_start|>Can you tell me a story?<|user_end|><|assistant_start|>
  10. chat 5.2
    <|bos|><|system_start|>Answer in one short sentence.<|system_end|><|user_start|>Can you tell me a story about a fish
  11. chat 5.18
    you today?<|assistant_end|><|user_start|>can you tell me a story about a dragon
  12. chat 5.16
    <|bos|><|system_start|>Answer in one short sentence.<|system_end|><|user_start|>Can you tell me a story about a bird