Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #3717

Fires on “ more” (not labeled yet: read the examples)

Fires on
0.37% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 42%
  • worksheet 22%
  • chat 19%
  • agent 16%
  • python 1%

Makes the model say

.+ Every: You careful heavy main

Makes it not say

Tim newThisrat whyTim the him

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 3.75
    , sharing is good." They learned that sharing and playing together is much more fun than playing alone
  2. worksheet 3.6
    .<|assistant_end|><|bos|>Lily had 70 flowers and found 68 more. Now Lily has
  3. worksheet 3.51
    Tim had 5298 stars and found 664 more. Now Tim has
  4. worksheet 3.48
    has 87274 apples. Tom gets 39 more apples. How many
  5. chat 3.42
    <|bos|><|user_start|>Sam has 63 coins. Sam gets 98 more coins. How many
  6. worksheet 3.33
    Tom had 164 balls and found 7145 more. Now Tom has
  7. chat 3.33
    <|assistant_end|><|bos|><|user_start|>Lily has 71 coins. Lily gets 8 more coins. How many
  8. story 3.32
    he was wrong. The hole was too small for him. He
  9. chat 3.32
    !<|assistant_end|><|bos|><|user_start|>Lucy has 6 balls. Lucy gets 4 more balls. How many
  10. chat 3.28
    : calculator<|system_end|><|user_start|>Mia has 2 coins. Mia gets 6 more coins. How many
  11. worksheet 3.28
    <|bos|>Lily had 16 balls and found 9947 more. Now Lily has
  12. story 3.25
    big leaf. But the leaf was too big for the ant.