Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #2412

Fires on “5” (not labeled yet: read the examples)

Fires on
0.49% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 86%
  • agent 6%
  • story 6%
  • chat 2%
  • python 0%

Makes the model say

whominnewString{<|tool_call_start|>allYou_*.

Makes it not say

Soak wind find dic onto happened

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 6.43
    ⏎Sue had 733 balls and found 73860 more. Now
  2. worksheet 6.4
    Ben had 6502 books and found 8819 more. Now Ben
  3. worksheet 6.13
    <|bos|>Tom had 164 balls and found 7145 more. Now Tom
  4. worksheet 5.97
    ⏎Sam had 733 cookies and found 79738 more. Now
  5. worksheet 5.9
    Sue had 9224 balls and found 8035 more. Now Sue
  6. worksheet 5.86
    Tim had 3946 flowers and found 31929 more. Now
  7. worksheet 5.79
    ⏎Tom had 868 books and found 8461 more. Now Tom
  8. worksheet 5.74
    Sam had 5662 flowers and found 6708 more. Now Sam
  9. worksheet 5.68
    had 28458 books and found 9406 more. Now Anna
  10. worksheet 5.65
    ⏎Anna had 263 flowers and found 1465 more. Now Anna
  11. worksheet 5.61
    ⏎Sam had 349 balls and found 3504 more. Now Sam
  12. worksheet 5.5
    <|bos|>Max had 287 coins and found 76758 more. Now