Skip to content
mini-lab
Features of prelude-2

Feature #3855

Fires on “ a” (not labeled yet: read the examples)

Fires on
0.58% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 72%
  • chat 19%
  • worksheet 4%
  • agent 3%
  • python 2%

Makes the model say

safe played happy loved fundef beautifulWow

Makes it not say

asked asks can togethere how do I

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 2.61
    <|bos|>One day, a little ball named B
  2. story 2.55
    a story, or some numbers to add?<|assistant_end|><|bos|>One day, a strong boy named Tom
  3. story 2.54
    spoiled apple was not so bad after all.<|bos|>One day, a small girl named Emma
  4. story 2.51
    scary, but it brought them a nice surprise.<|bos|>One day, a little boy named Tim
  5. story 2.51
    .<|assistant_end|><|bos|>One day, a young boy named Tim
  6. story 2.5
    found the big, shiny balloon in the tree.<|bos|>One day, a little boy named Tim
  7. story 2.5
    bravest animal in the whole jungle.<|bos|>One day, a grumpy bear named Ben
  8. story 2.5
    when she went exploring.<|bos|>One day, a little boy named Tim
  9. story 2.49
    ent and accepted Tom's help.<|bos|>One day, a little boy named Tim
  10. story 2.49
    <|assistant_start|>The answer is 948.<|assistant_end|><|bos|>One day, a boy named Tim went
  11. story 2.49
    helping him to prevent further danger.<|bos|>One day, a little girl named Amy
  12. story 2.49
    1656<|think_end|>1656<|assistant_end|><|bos|>One day, a wise old tree stood