Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #1049

Fires on “Lily” (not labeled yet: read the examples)

Fires on
0.52% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 59%
  • chat 20%
  • agent 17%
  • worksheet 4%
  • python 1%

Makes the model say

and Lily=**/ sundemo mean likedM

Makes it not say

):If heThe$ throwMyape

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 5.29
    <|assistant_end|><|bos|>Lily loves to dance.
  2. story 5.28
    <|bos|>Anna loved animals. She
  3. story 5.19
    in `main.py`.<|assistant_end|><|bos|>Lily and Ben are playing
  4. story 4.98
    items)`. The tests pass now.<|assistant_end|><|bos|>Lily and Ben are playing
  5. story 4.77
    537.<|assistant_end|><|bos|>One day, a lively girl named Mia found a kay
  6. story 4.72
    the even numbers of nums.<|assistant_end|><|bos|>One day, a girl named Lily wanted to mix colors
  7. story 4.69
    <|assistant_end|><|bos|>Once upon a time, there was a sweet little girl named Mia. Mia loved to
  8. story 4.68
    552<|think_end|>The answer is 552.<|assistant_end|><|bos|>Lily was a green bird
  9. story 4.67
    ELLO⏎```<|assistant_end|><|bos|>Lily loved to dance.
  10. story 4.66
    , in a bright, sunny house, there lived a little girl named Lily. She loved to
  11. story 4.65
    7=7, 790<|think_end|>790<|assistant_end|><|bos|>Lily and Ben are friends
  12. story 4.63
    asking me for a story!<|assistant_end|><|bos|>One day, a girl named Lily was in the kitchen