Skip to content
mini-lab
Features of prelude-2

Feature #1007

Fires on “ a” (not labeled yet: read the examples)

Fires on
1.03% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 69%
  • chat 23%
  • agent 5%
  • python 2%
  • worksheet 1%

Makes the model say

for arying pminlet

Makes it not say

<|bos|> listen:Finallyobread surprise listened

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 4.62
    <|bos|>One day, a little ball named B
  2. story 4.49
    843.<|assistant_end|><|bos|>One day, a boy named Tim went
  3. story 4.43
    82347 apples.<|bos|>One day, a little girl named Mia
  4. story 4.4
    , 584<|think_end|>584<|assistant_end|><|bos|>One day, a big cat named Tom
  5. story 4.38
    Lucy has 11626 toys.<|bos|>One day, a smart girl named Lisa
  6. story 4.38
    , 968<|think_end|>968<|assistant_end|><|bos|>One day, a little plane was flying
  7. story 4.37
    39 = 74763.<|bos|>One day, a little boy named Tim
  8. story 4.37
    be more careful with his toy weapon.<|bos|>One day, a cat named Bow
  9. story 4.36
    .<|assistant_end|><|bos|>One day, a young boy named Tim
  10. story 4.35
    when she went exploring.<|bos|>One day, a little boy named Tim
  11. story 4.35
    + 73 = 82.<|bos|>One day, a little girl named Sue
  12. story 4.34
    1656<|think_end|>1656<|assistant_end|><|bos|>One day, a wise old tree stood