Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #107

"a" in "Once upon a time"

Fires on
0.65% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 72%
  • chat 25%
  • python 2%
  • worksheet 1%
  • agent 0%

Makes the model say

time her play ground a played an for

Makes it not say

anged":demopath files everything voicepped

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 3.73
    ```<|assistant_end|><|bos|>Once upon a time, there was
  2. story 3.72
    to show everyone back home!<|bos|>Once upon a time, in a
  3. story 3.65
    the snow all day.<|bos|>Once upon a time, there were
  4. story 3.65
    together.<|bos|>Once upon a time there was a
  5. story 3.64
    61799.<|bos|>Once upon a time, there was
  6. story 3.63
    .<|assistant_end|><|bos|>Once upon a time there were two
  7. story 3.63
    .<|assistant_end|><|bos|>Once upon a time, there was
  8. story 3.63
    with `final_letter(s)`.<|assistant_end|><|bos|>Once upon a time, there was
  9. story 3.62
    Python files in this project.<|assistant_end|><|bos|>Once upon a time, there was
  10. story 3.59
    is 70.<|assistant_end|><|bos|>Once upon a time, there was
  11. story 3.58
    0.<|assistant_end|><|bos|>Once upon a time, there was
  12. chat 3.57
    Can you tell me a story about the sea?<|user_end|><|assistant_start|>Once upon a time, there was