Skip to content
mini-lab
Features of prelude-2

Feature #1531

Fires on “ a” (not labeled yet: read the examples)

Fires on
0.41% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 62%
  • chat 27%
  • agent 8%
  • python 2%
  • worksheet 1%

Makes the model say

walk friend thing new good ch look subtract

Makes it not say

<|tool_call_end|>alculator_*. sorry full<|arg|> wing_

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 9.63
    ing away the day.⏎One day, Fluffy decided to go for a walk around the yard
  2. story 9.61
    His name was Hank. One day, he decided to go for a walk in search of
  3. story 9.44
    who loved to play outside. One day, she decided to go for a walk in the woods
  4. chat 8.9
    ⏎One day it felt very hot and wanted to go for a swim. It flew
  5. story 8.9
    sea. One day, his mom said, "Let's go for a swim!" The little
  6. story 8.77
    fun.<|assistant_end|><|bos|>One day, a cat named Jazz went for a walk. Jazz
  7. story 8.73
    day, a big dog named Max went for a walk with his friend
  8. story 8.63
    sack. One day, he went for a walk in the park
  9. story 8.47
    named John who lived by the sea. One day, John went for a walk by the beach
  10. story 8.47
    a curious little boy named Tim went for a walk. He saw
  11. story 8.33
    <|assistant_end|><|bos|>One day, Tom and his dog, Spot, went for a drive. They saw
  12. chat 8.28
    about a bunny.<|user_end|><|assistant_start|>One day, Poppy the bunny went for a walk.<|assistant_end|><|bos|>