Skip to content
mini-lab
Features of prelude-2

Feature #3107

Fires on “y” (not labeled yet: read the examples)

Fires on
4.44% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 50%
  • agent 42%
  • chat 7%
  • python 1%
  • worksheet 1%

Makes the model say

'sa lesson cat whoasoodell

Makes it not say

plusreetb[nyvent Pythonust

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 6.42
    <|bos|>Once upon a time, there was a little spark named Sparky. Sparky
  2. story 6.1
    Once upon a time, there was a little car named Speedy. Speed
  3. story 5.99
    <|bos|>Once upon a time, there was a little engine named Eddie. Eddie
  4. story 5.93
    .<|bos|>Once upon a time, there was a little girl called Emily. She was only
  5. story 5.93
    .<|bos|>Once upon a time there was a little girl named Lizzy. She was so
  6. chat 5.82
    upon a time, in a small town, there was an unusual dancer named Lily.
  7. story 5.82
    her and replied, "Hi, Lily. My name is Ziggy." Lily was happy
  8. story 5.8
    to yourself.<|bos|>Once there was a pretty little girl called Millie. One day her
  9. story 5.75
    + i⏎ return acc⏎```⏎<|bos|>Little Reema was so excited to
  10. story 5.74
    .<|bos|>Once upon a time there was a little girl called Millie. She was three
  11. story 5.71
    py`.<|assistant_end|><|bos|>Once upon a time, there was a smart dancer named Lily. She
  12. story 5.57
    <|bos|>Once upon a time, there was a young girl named Claire. She was playing