Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #1351

Fires on “,” (not labeled yet: read the examples)

Fires on
0.90% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 60%
  • chat 21%
  • agent 15%
  • worksheet 2%
  • python 2%

Makes the model say

little I , m mom but M

Makes it not say

<|assistant_end|> filespython.<|tool_end|><|think_start|>!")ings

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 7.82
    around in the air.⏎"Look, Amy! A net
  2. story 7.3
    . She had found a shell for her collection.⏎"Look, Mom, look what
  3. story 7.18
    in the bowl. She mixes it with the spoon. "Look, it's thick!"
  4. story 6.85
    comb. She wanted to try it on her hair.⏎"Look, Tom, I found
  5. story 6.78
    says, "I know, Tom. I like
  6. story 6.64
    says. "Can we eat it?"⏎"I don't know, Lily. Maybe it
  7. story 6.6
    saw the bird come back and land on the tree.⏎"Look, Mom!" he said
  8. story 6.6
    saw the lip too, and felt scared. "Don't worry, it's just John
  9. story 6.53
    harsh. He got a little scared.⏎"It's okay, Timmy," his mom
  10. story 6.52
    and sad. He says, "I'm sorry, Mom, Dad,
  11. story 6.51
    picked it up and waved it around in the air.⏎"Look, Amy! A net
  12. story 6.44
    I'm sorry, Ben," Sam said.⏎"I'm sorry, Sam," Ben said