Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #1057

Fires on “ boy” (not labeled yet: read the examples)

Fires on
0.18% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 63%
  • agent 21%
  • chat 13%
  • python 2%
  • worksheet 1%

Makes the model say

<|assistant_end|> flew `[::aei wanted nums):

Makes it not say

She muchs are more she little is

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 3.42
    <|think_end|>The answer is 8.<|assistant_end|><|bos|>One day, a little girl named Lily was playing
  2. story 3.35
    73 = 82.<|bos|>One day, a little girl named Sue went to
  3. story 3.33
    big, shiny balloon in the tree.<|bos|>One day, a little boy named Tim was playing
  4. story 3.32
    and they all lived happily ever after.<|bos|>One day, a little boy named Tom saw a
  5. story 3.32
    799.<|bos|>Once upon a time, there was a little boy named Tim. He
  6. story 3.31
    time, there was a little boy named Tim. Tim
  7. story 3.3
    The answer is 53.<|assistant_end|><|bos|>One day, a little girl named Mia went to
  8. story 3.3
    .py`.<|assistant_end|><|bos|>Once upon a time, there was a little boy named Tim. Tim
  9. story 3.3
    22.<|assistant_end|><|bos|>Once upon a time, there was a little boy named Tom. He
  10. story 3.29
    75 = 477.<|bos|>One day, a little boy named Tim wanted to
  11. story 3.29
    answer is 201.<|assistant_end|><|bos|>One day, a little boy named Tim got an
  12. story 3.28
    4⏎```<|assistant_end|><|bos|>Once upon a time, there was a little boy named John who lived