Skip to content
mini-lab
Features of prelude-2

Feature #2406

Fires on “.” (not labeled yet: read the examples)

Fires on
1.00% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 73%
  • story 17%
  • agent 8%
  • python 1%
  • worksheet 0%

Makes the model say

It a plus uponOnce numbers<|bos|>One

Makes it not say

fell toys goneb things return them Sometimes

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 4.98
    in one short sentence.<|system_end|><|user_start|>Tell me a story about a cat.<|user_end|><|assistant_start|>One day
  2. chat 4.94
    in one short sentence.<|system_end|><|user_start|>Tell me a story about a cat.<|user_end|><|assistant_start|>One day
  3. chat 4.7
    body in need.<|bos|><|user_start|>Tell me a story about a fish.<|user_end|><|assistant_start|>Once upon
  4. chat 4.67
    tests pass now.<|assistant_end|><|bos|><|user_start|>Tell me a story about a bird.<|user_end|><|assistant_start|>Once upon
  5. chat 4.67
    all tests passed.<|assistant_end|><|bos|><|user_start|>Write a short story about a bird.<|user_end|><|assistant_start|>One day
  6. chat 4.65
    about the war and were happy.<|bos|><|user_start|>Write a story for me.<|user_end|><|assistant_start|>One day
  7. chat 4.63
    <|bos|><|system_start|>Answer in one short sentence.<|system_end|><|user_start|>Tell me a story.<|user_end|><|assistant_start|>One day
  8. chat 4.61
    kindness of those around him.<|bos|><|user_start|>Tell me a story.<|user_end|><|assistant_start|>Once upon
  9. chat 4.61
    stories and add numbers.<|assistant_end|><|user_start|>Tell me a story about a cat.<|user_end|><|assistant_start|>One day
  10. chat 4.6
    and played until the sun went down.<|bos|><|user_start|>Tell me a story.<|user_end|><|assistant_start|>Once upon
  11. chat 4.57
    + b⏎```⏎<|bos|><|user_start|>Tell me a story about a bird.<|user_end|><|assistant_start|>Once upon
  12. chat 4.57
    I help you today?<|assistant_end|><|user_start|>I want a story about a bird!<|user_end|><|assistant_start|>Once upon