Skip to content
mini-lab
Features of prelude-2

Feature #3284

Fires on “,” (not labeled yet: read the examples)

Fires on
0.34% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 65%
  • chat 29%
  • agent 4%
  • python 1%
  • worksheet 0%

Makes the model say

there⏎⏎ a one, camear in

Makes it not say

'reely'taveTim5Pry

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 5.13
    tell me a story about a boat<|user_end|><|assistant_start|>Once upon a time, there was a n
  2. chat 5.04
    tell me a story about a ball?<|user_end|><|assistant_start|>Once upon a time, there was a unique
  3. chat 5.0
    <|user_start|>Can you tell me a story?<|user_end|><|assistant_start|>Once upon a time, there was a large
  4. chat 4.98
    tell me a story about a tree?<|user_end|><|assistant_start|>Once upon a time, in a small town
  5. chat 4.96
    <|user_start|>Can you tell me a story?<|user_end|><|assistant_start|>Once upon a time, there was a sailor
  6. chat 4.95
    <|user_start|>Can you tell me a story?<|user_end|><|assistant_start|>Once upon a time, there was a little
  7. chat 4.94
    <|user_start|>Can you tell me a story?<|user_end|><|assistant_start|>Once upon a time, there was a girl
  8. chat 4.94
    <|assistant_end|><|user_start|>tell me a short story<|user_end|><|assistant_start|>Once upon a time, there was a girl
  9. chat 4.92
    <|assistant_end|><|bos|><|user_start|>Tell me a story.<|user_end|><|assistant_start|>Once upon a time, there was a l
  10. chat 4.91
    tell me a story about a boat<|user_end|><|assistant_start|>Once upon a time, there was a n
  11. chat 4.91
    tell me a story about a car?<|user_end|><|assistant_start|>Once upon a time, there was a little
  12. chat 4.91
    tell me a story about a fish?<|user_end|><|assistant_start|>Once upon a time, in a big blue