Skip to content
mini-lab
Features of prelude-2

Feature #1808

Fires on “ little” (not labeled yet: read the examples)

Fires on
0.57% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 56%
  • chat 33%
  • agent 9%
  • python 1%
  • worksheet 1%

Makes the model say

boy girl years't friend H'mfe

Makes it not say

So",],oldStringFrom much From far

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 4.52
    <|bos|>One day, a little ball named Bou
  2. story 4.28
    Lucy for making it look so pretty.<|bos|>One day, a little cat named Q
  3. story 4.27
    when she went exploring.<|bos|>One day, a little boy named Tim was
  4. chat 4.27
    Tell me a story about the park.<|user_end|><|assistant_start|>One day, a little girl named Amy was
  5. story 4.22
    82347 apples.<|bos|>One day, a little girl named Mia went
  6. story 4.2
    named Pup was playing in the park.<|assistant_end|><|bos|>Molly was a little girl who loved to
  7. story 4.17
    + 73 = 82.<|bos|>One day, a little girl named Sue went
  8. story 4.16
    <|assistant_start|>The answer is 53.<|assistant_end|><|bos|>One day, a little girl named Mia went
  9. story 4.16
    The answer is 738.<|assistant_end|><|bos|>One day, a little boy named Tim found
  10. story 4.14
    8<|think_end|>The answer is 8.<|assistant_end|><|bos|>One day, a little girl named Lily was
  11. story 4.13
    only tell short stories and add numbers.<|assistant_end|><|bos|>One day, a little girl named Sue found
  12. story 4.1
    on a laptop by mini-lab.<|assistant_end|><|bos|>One day, a little boy named Tim went