Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #1231

Fires on “ named” (not labeled yet: read the examples)

Fires on
0.38% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 66%
  • chat 20%
  • python 7%
  • agent 6%
  • worksheet 0%

Makes the model say

<|assistant_end|><|user_start|><|assistant_start|><|think_end|> Tim trained<|tool_call_end|>ier

Makes it not say

a, and import two that," the

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 6.99
    a little boy named Tim. Tim was
  2. story 6.99
    a little boy named Tim and his dog
  3. story 6.8
    day, a big dog named Max went for a
  4. story 6.76
    a little girl named Lily heard a secret
  5. chat 6.76
    a little girl named Lucy went to the
  6. chat 6.72
    story about a bird?<|user_end|><|assistant_start|>One day, a little dog named Spot was in the
  7. chat 6.68
    <|user_end|><|assistant_start|>One day, a little dog named Pup was playing
  8. story 6.58
    was a small dog named Spot. Spot liked
  9. story 6.57
    time, there was a sleepy cat named Tom. Tom loved
  10. story 6.57
    2.<|assistant_end|><|bos|>Once upon a time, there was a shy cat named Kitty. Kitty loved
  11. story 6.55
    a curious little boy named Tim went for a
  12. story 6.54
    One day, a small boy named Tim found a ph