Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #3943

Fires on “ How” (not labeled yet: read the examples)

Fires on
0.17% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 37%
  • chat 34%
  • agent 18%
  • story 7%
  • python 4%

Makes the model say

(one many accifvowelsre!")

Makes it not say

out⏎ go named y st,fort

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 3.65
    87 stars. Anna gets 872 more stars. How many stars does Anna
  2. worksheet 3.6
    6 shells. Tim gets 72522 more shells. How many shells does Tim
  3. chat 3.52
    has 10 toys. Ben gets 80 more toys. How many toys does Ben
  4. worksheet 3.5
    5100.⏎Mia has 823 apples. Mia gets 60
  5. worksheet 3.49
    6490.<|bos|>Mia has 208 coins. Mia gets 97
  6. worksheet 3.48
    The tests pass now.<|assistant_end|><|bos|>Lucy has 67 shells. Lucy gets 47
  7. chat 3.47
    has 19 cookies. Tim gets 76 more cookies. How many cookies does Tim
  8. worksheet 3.45
    330.<|assistant_end|><|bos|>Mia has 434 apples. Mia gets 24
  9. chat 3.42
    Tim has 30 stickers. Tim gets 3 more stickers. How many stickers does Tim
  10. worksheet 3.42
    564.⏎Mia has 3057 shells. Mia gets 53
  11. chat 3.4
    is 28.<|assistant_end|><|user_start|>Lily has 47 books. Lily gets 45
  12. worksheet 3.4
    7274 apples. Tom gets 39 more apples. How many apples does Tom