Skip to content
mini-lab
Features of prelude-2

Feature #2318

Fires on “ sh” (not labeled yet: read the examples)

Fires on
0.15% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 69%
  • story 15%
  • chat 12%
  • python 3%
  • worksheet 1%

Makes the model say

multipl x passed groworedaking town])`

Makes it not say

boy overogll TomOho⏎

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 2.25
    dust had settled back to the ground.⏎The sun shone brightly again
  2. story 2.16
    it and ran to tell her mommy.⏎"Mommy, my toys shrunk!" she
  3. story 2.14
    3204 = 4173.<|bos|>The sun shone brightly and
  4. story 2.14
    . He touched it and felt how cold it was. As the sun shone on the ice
  5. story 2.01
    big and strong, so she watered it every day. The sun shone on the flower
  6. story 1.97
    ? Maybe they will make you feel better." Mia says.⏎Tom shakes his head.
  7. story 1.97
    zy was so frustrated and sad because she wanted to stay outside. She shut the door behind
  8. story 1.92
    . The bird was so happy! The light in the bird's eyes shined bright. The
  9. story 1.9
    . She loved Anna and Ben and wanted to help them.⏎She shooed the
  10. story 1.86
    ? Have you ever asked a carrot?" Ben says.⏎Lily shakes her head.
  11. agent 1.84
    math_utils.py<|tool_call_end|><|assistant_end|><|tool_start|>all tests passed⏎<|tool_end|><|assistant_start|>
  12. story 1.75
    "You have to finish. It is my turn now."⏎Sam shakes his head.