Skip to content
mini-lab
Features of prelude-2

Feature #3171

Fires on “ill” (not labeled yet: read the examples)

Fires on
1.08% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 66%
  • agent 18%
  • chat 14%
  • python 1%
  • worksheet 0%

Makes the model say

friendspy'sa([ loved toy proud

Makes it not say

<|assistant_start|>vowels But<|tool_end|>",`,<|tool_call_end|> trained

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 5.16
    , little rabbit named Ralph. He lived
  2. story 4.89
    .<|assistant_end|><|bos|>Once upon a time, there were two friends called Drew and Jack. Every
  3. story 4.76
    Millie was very happy
  4. story 4.7
    was a little girl named June. June was 3
  5. story 4.68
    when a big wind came. The wind was so strong it blew Mittens up into a
  6. story 4.61
    .⏎One day, Blue had an idea. He said to Red, "Let's
  7. story 4.57
    things to yourself.<|bos|>Once there was a pretty little girl called Millie. One day
  8. story 4.55
    to tell stories to his friends in the woods. One day, Foxy found a
  9. story 4.5
    They were patient and kind and she loved playing with them. But Joy didn't think
  10. story 4.49
    , there was a little car named Speedy. Speedy loved to go
  11. story 4.45
    They smiled and hugged the red train. They decided to name it Ruby. They played
  12. story 4.45
    9.<|bos|>Once upon a time there was a little girl called Millie. She was