Skip to content
mini-lab
Features of prelude-2

Feature #2970

Fires on “ the” (not labeled yet: read the examples)

Fires on
0.88% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 81%
  • chat 10%
  • agent 6%
  • python 2%
  • worksheet 0%

Makes the model say

ground should floor's grass back farm p

Makes it not say

<|tool_call_end|> passes⏎⏎ friendsOnce function ? eyes

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 8.92
    big red ball on the clear street. He
  2. story 7.27
    a yellow ball on the floor.⏎"
  3. story 7.11
    big shoe on his bed. It was
  4. story 6.82
    a key. They looked around and saw a shiny metal thing on the ground. It was
  5. story 6.81
    They lay down on the grass and watched the
  6. story 6.8
    <|bos|>Once upon a time, there was a little girl who lived on a gloomy day. She
  7. story 6.74
    day, a boy named Tim found sunglasses on the ground. He picked
  8. story 6.69
    outside. He saw a big wall and wanted to see what was on the other side.⏎
  9. story 6.67
    Sue took her big dough ball outside to show her friends. But on the way, she saw
  10. chat 6.66
    was looking for food. He was very hungry. Spot saw something on the ground that he did
  11. story 6.63
    on it. It was
  12. chat 6.63
    on, they had many