Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #911

Fires on “,” (not labeled yet: read the examples)

Fires on
0.45% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 67%
  • chat 23%
  • python 8%
  • agent 1%
  • worksheet 0%

Makes the model say

there in, There lived tree on a

Makes it not say

plusSE<|arg|><|assistant_end|>":edased[::-

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 6.91
    <|assistant_end|><|bos|>Once upon a time, there was a big
  2. story 6.87
    105<|think_end|>105<|assistant_end|><|bos|>Once upon a time, there was a little
  3. story 6.79
    text.py`, line 1.<|assistant_end|><|bos|>Once upon a time, a bald man named
  4. chat 6.79
    tell me a story?<|user_end|><|assistant_start|>Once upon a time, there was a girl
  5. story 6.77
    with `final_letter(s)`.<|assistant_end|><|bos|>Once upon a time, there was a big
  6. chat 6.69
    <|user_start|>Can you tell me a story?<|user_end|><|assistant_start|>Once upon a time, there was a girl
  7. chat 6.66
    tell me a story about a boat<|user_end|><|assistant_start|>Once upon a time, there was a n
  8. chat 6.65
    you tell me a story about a dragon<|user_end|><|assistant_start|>Once upon a time, there was a pink
  9. story 6.65
    Python files in this project.<|assistant_end|><|bos|>Once upon a time, there was a gift
  10. story 6.65
    495<|assistant_end|><|bos|>Once upon a time, in a small house
  11. chat 6.64
    I want a story about a princess!<|user_end|><|assistant_start|>Once upon a time, there was a princess
  12. story 6.63
    py`.<|assistant_end|><|bos|>Once upon a time, there was a small