Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #457

Fires on “8” (not labeled yet: read the examples)

Fires on
2.65% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 78%
  • chat 16%
  • agent 2%
  • python 2%
  • story 1%

Makes the model say

6even7<|think_end|>`.her98

Makes it not say

modelOnce([#Renameday ` file

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 4.66
    friends.<|bos|>Tom had 5 toys and found 41886 more. Now
  2. worksheet 4.64
    4+0=4, 4798⏎9+0
  3. worksheet 4.63
    0+2=2, 22261⏎So
  4. worksheet 4.57
    56350 plus 9
  5. worksheet 4.49
    1500⏎9+0
  6. worksheet 4.46
    1.⏎Ben had 2 shells and found 2320 more. Now Ben
  7. worksheet 4.46
    2.⏎Ben had 2 books and found 15706 more. Now
  8. worksheet 4.44
    +0: 4+0=4, 45384⏎So
  9. worksheet 4.39
    +0+1=4, 4138⏎2+0
  10. worksheet 4.39
    .⏎Lily has 9 cookies. Lily gets 7589 more cookies. How
  11. worksheet 4.37
    <|bos|>Tim has 86 shells. Tim gets 72522 more shells.
  12. worksheet 4.37
    +81658: 6