Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #94

Fires on “ and” (not labeled yet: read the examples)

Fires on
1.17% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 88%
  • chat 7%
  • python 2%
  • agent 2%
  • worksheet 1%

Makes the model say

two they backw nodded cThey together

Makes it not say

<|think_end|>configFalse adds]`. asks,"Look

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 5.78
    boy smiled and said, "Sure
  2. story 5.34
    want my hands to hurt." Mom smiled and gave Lily warm gl
  3. story 5.33
    pretty!"⏎Mom smiled and hugged Lily. "
  4. story 4.9
    mistakes." Lucy smiled and felt better. She
  5. story 4.89
    smiled and said, "I
  6. story 4.79
    Mia smiled and said, "R
  7. story 4.78
    Yes mummy. I will stay close to you."⏎Mum smiled and said, "Good
  8. story 4.71
    together then! That will make you feel better!"⏎Her dad smiled and said, "Let
  9. story 4.64
    tested it so it's safe."⏎The older sister smiled and said, "Me
  10. story 4.48
    's mom smiles and says, "That
  11. story 4.48
    meat instead?" Daddy smiled and replied, "Yes
  12. story 4.45
    make me think of how clever you are."⏎The little girl smiled and said: "I