Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #2738

Fires on “ for” (not labeled yet: read the examples)

Fires on
0.71% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 35%
  • agent 31%
  • chat 21%
  • python 13%
  • worksheet 0%

Makes the model say

` `"json calculator<|tool_call_start|>ins<|think_start|> laptop

Makes it not say

,. for when of that and who

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 4.52
    of fun.<|assistant_end|><|bos|>One day, a cat named Jazz went for a walk. J
  2. chat 4.39
    about a cat.<|user_end|><|assistant_start|>One day, a little pink cat went for a walk.<|assistant_end|>
  3. story 4.29
    story!<|assistant_end|><|bos|>One day, a little dog named Lucky went for a walk. He
  4. chat 4.27
    Tell me a story.<|user_end|><|assistant_start|>One day, a furry dog went for a walk.<|assistant_end|>
  5. story 4.2
    you today?<|assistant_end|><|bos|>One day, a big, serious bear went for a walk in the
  6. story 4.17
    a curious little boy named Tim went for a walk. He
  7. chat 4.17
    the sun.<|user_end|><|assistant_start|>One day, a little girl named Lucy went for a walk. The
  8. chat 4.16
    time...<|user_end|><|assistant_start|>One day, a little girl named Mia went for a walk. She
  9. story 4.15
    47 apples.<|bos|>One day, a little girl named Mia went for a walk. She
  10. chat 4.14
    the sun?<|user_end|><|assistant_start|>One day, a little boy named Tim went for a walk in the
  11. story 4.13
    project.<|assistant_end|><|bos|>One day, a mighty big cat named Tom went for a walk. He
  12. story 4.13
    girl who loved to play outside. One day, she decided to go for a walk in the