Skip to content
mini-lab
Features of prelude-2

Feature #1263

Fires on “,” (not labeled yet: read the examples)

Fires on
0.36% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 71%
  • chat 22%
  • agent 7%
  • python 1%
  • worksheet 0%

Makes the model say

=**/oldStringag`: thank gigg happened

Makes it not say

6readest:5 orAs and

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 4.43
    <|assistant_end|><|bos|>Once upon a time, there was a big
  2. story 4.42
    105<|think_end|>105<|assistant_end|><|bos|>Once upon a time, there was a little
  3. chat 4.37
    you tell me a story about a dragon<|user_end|><|assistant_start|>Once upon a time, there was a pink
  4. story 4.35
    3, 39<|think_end|>39<|assistant_end|><|bos|>Once upon a time, there was a girl
  5. chat 4.31
    tell me a story about a fish?<|user_end|><|assistant_start|>Once upon a time, in a big blue
  6. chat 4.3
    tell me a story about a cake?<|user_end|><|assistant_start|>Once upon a time, there was a tall
  7. story 4.3
    with `final_letter(s)`.<|assistant_end|><|bos|>Once upon a time, there was a big
  8. chat 4.27
    <|user_start|>Can you tell me a story?<|user_end|><|assistant_start|>Once upon a time, there was a large
  9. story 4.26
    text.py`, line 1.<|assistant_end|><|bos|>Once upon a time, a bald man named
  10. chat 4.26
    tell me a story?<|user_end|><|assistant_start|>Once upon a time, there was a girl
  11. chat 4.25
    tell me a story about a princess?<|user_end|><|assistant_start|>Once upon a time, there was a princess
  12. chat 4.25
    <|user_start|>Can you tell me a story?<|user_end|><|assistant_start|>Once upon a time, there was a sailor