Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #1062

Fires on “ and” (not labeled yet: read the examples)

Fires on
0.25% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 53%
  • story 20%
  • chat 18%
  • agent 7%
  • python 2%

Makes the model say

path<|assistant_start|>script`,<|user_end|>oldString defines defined

Makes it not say

0 high⏎ theyr: went>>>

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 4.15
    747.<|assistant_end|><|bos|>Tim had 7111 toys and found 68
  2. worksheet 4.13
    78031.<|bos|>Lucy had 7 toys and found 3 more.
  3. worksheet 3.97
    166.<|assistant_end|><|bos|>Ben had 3512 toys and found 65
  4. worksheet 3.95
    is 109.<|assistant_end|><|bos|>Lily had 70 flowers and found 68
  5. worksheet 3.89
    4467.⏎Lucy had 31 balls and found 277
  6. worksheet 3.86
    613.<|assistant_end|><|bos|>Sue had 8712 toys and found 54
  7. worksheet 3.83
    49516.⏎Sam had 63 books and found 329
  8. worksheet 3.8
    218.⏎Lucy had 33299 toys and found 34
  9. worksheet 3.78
    1308.⏎Sam had 349 balls and found 350
  10. worksheet 3.76
    = 1377⏎Ben had 41 apples and found 38
  11. worksheet 3.75
    610.⏎Anna had 75415 apples and found 6 more
  12. worksheet 3.74
    1219.⏎Sam had 67 shells and found 9 more.