Skip to content
mini-lab
Features of prelude-2

Feature #1157

Fires on “ the” (not labeled yet: read the examples)

Fires on
0.80% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 67%
  • chat 17%
  • worksheet 7%
  • agent 6%
  • python 3%

Makes the model say

big sun wind after grass soft tests leaves

Makes it not say

<|arg|>⏎<|tool_end|>py<|assistant_end|>expression. Inside

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 5.76
    walking through the forest when she noticed
  2. story 5.71
    Mom and Dad. They liked to play in the sand and splash in the water. They saw
  3. story 5.68
    mom and dad. They liked to play in the sand and splash in the water. They saw
  4. story 5.47
    small dog named Tim went for a walk. He liked to walk in the park. He was
  5. story 5.26
    0<|assistant_end|><|bos|>Lily and Ben are friends. They like to play in the garden. They see
  6. story 5.26
    outside and march around her backyard under the bright sun. She
  7. story 5.24
    around in the air.⏎"
  8. story 5.2
    was a small cat named Tom. Tom liked to run and play in the dust. He
  9. story 5.17
    <|assistant_end|><|bos|>Lila and Sam were best friends. They liked to play in the park every day.
  10. story 5.12
    }⏎<|bos|>Lila and Ben are friends. They like to play in the park. One day
  11. story 5.1
    letter(s)`.<|assistant_end|><|bos|>Tim and Liz liked to play in the attic. They
  12. story 5.08
    <|assistant_end|><|bos|>Lily loved to dance. She danced in her room, in the garden, and in