Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #725

Fires on “ ” (not labeled yet: read the examples)

Fires on
0.50% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 42%
  • chat 18%
  • agent 16%
  • story 12%
  • python 12%

Makes the model say

Sorryitem$ smilesmin mini<|user_start|> calculator

Makes it not say

. has,! " took Why because

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 2.53
    46 + 0 = 46.⏎Lucy had 54 shells and found
  2. worksheet 2.49
    84 = 13218.⏎Lucy had 33299
  3. worksheet 2.46
    59 = 97959.⏎Tim had 91792
  4. worksheet 2.46
    <|assistant_end|><|bos|>Tom has 8727
  5. worksheet 2.46
    = 53757⏎Anna had 263 flowers
  6. worksheet 2.45
    23 is 55269.⏎Lucy had 298 books and
  7. worksheet 2.42
    bye! Have a nice day.<|assistant_end|><|bos|>Tim has 86 shells.
  8. chat 2.42
    tests" or "Rename add to plus".<|assistant_end|><|bos|><|user_start|>Anna has 87 stars.
  9. worksheet 2.41
    41 is 72438.⏎Mia had 8 balls and found
  10. worksheet 2.41
    68 = 97079.⏎Lily had 3 apples and found
  11. worksheet 2.4
    scratch on a laptop by mini-lab.<|assistant_end|><|bos|>Anna had 21 books and found
  12. worksheet 2.39
    559 = 18591⏎Tom has 13 cookies. Tom