Skip to content
mini-lab
Features of prelude-2

Feature #2957

Fires on “ the” (not labeled yet: read the examples)

Fires on
0.05% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 46%
  • worksheet 29%
  • agent 10%
  • chat 9%
  • python 5%

Makes the model say

0Hey feeling ear tail idea x⏎

Makes it not say

$end And spentCreated):ter hard

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 1.46
    one of the ears of corn from the stalk and loved the way it felt in
  2. story 1.45
    day, Kitty heard a soft "meow" coming from the box
  3. story 1.24
    arrow. We can be like heroes in a story!" Tim liked the idea, so they
  4. story 1.21
    to her dictionary. She looked at the word "bitter" again. Suddenly tears
  5. story 1.13
    on the big cat's tail by mistake. The big cat let out a loud "meow
  6. story 1.11
    minus x.<|assistant_end|><|bos|>Once upon a time, there was an ordinary fish named Bob.
  7. story 1.1
    cakes with sand and pretend to be a chef. Ben liked the big space more,
  8. story 1.09
    important than family.<|bos|>Once upon a time, there was a restless boy named Tim.
  9. story 1.09
    lots of fun.<|bos|>Once upon a time, there was an ordinary boy named Tim.
  10. story 1.08
    started to talk! The tree said,
  11. story 1.07
    noticed that the cube started to move! Mia flew all around the room in
  12. chat 1.06
    me a story about a tree?<|user_end|><|assistant_start|>One day, a restless dog