Skip to content
mini-lab
Features of prelude-2

Feature #3575

Fires on โ€œ,โ€ (not labeled yet: read the examples)

Fires on
0.36% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 67%
  • chat 26%
  • agent 4%
  • python 2%
  • worksheet 1%

Makes the model say

there two a lots an all doubleOne

Makes it not say

`ap.<|tool_call_end|>Thank6Lily functions

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 3.58
    they all lived happily in their hive.<|bos|>Once upon a time, there was a dog
  2. story 3.58
    to show everyone back home!<|bos|>Once upon a time, in a small village
  3. chat 3.54
    tell me a story?<|user_end|><|assistant_start|>Once upon a time, there was a girl
  4. story 3.52
    that sharing with others can make everyone happy.<|bos|>Once upon a time, there was a little
  5. chat 3.49
    <|user_start|>Can you tell me a story?<|user_end|><|assistant_start|>Once upon a time, there was a girl
  6. story 3.48
    โŽThe end.<|bos|>Once upon a time, in a wild world, there lived a little
  7. chat 3.47
    tell me a story about a fish?<|user_end|><|assistant_start|>Once upon a time, in a big blue
  8. chat 3.46
    tell me a story about a car?<|user_end|><|assistant_start|>Once upon a time, there was a little
  9. story 3.46
    105<|think_end|>105<|assistant_end|><|bos|>Once upon a time, there was a little
  10. chat 3.46
    <|user_start|>Can you tell me a story?<|user_end|><|assistant_start|>Once upon a time, there was a large
  11. chat 3.45
    .<|bos|><|user_start|>Tell me a story.<|user_end|><|assistant_start|>Once upon a time, there was a dog
  12. story 3.45
    the diary before planning a big meal.<|bos|>Once upon a time, there were two friends