Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #1756

Fires on “ more” (not labeled yet: read the examples)

Fires on
2.50% of tokens
Mostly in
python
Layer
after block 4

Where it fires

  • python 31%
  • agent 28%
  • worksheet 28%
  • chat 9%
  • story 4%

Makes the model say

. <! Now trainedP andn

Makes it not say

bigger3er big workest Tom run

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. python 14.16
    ⏎print("all tests passed")⏎⏎$ python3 test_utils.py⏎all
  2. worksheet 13.53
    had 3075 balls and found 6333 more. Now Mia has
  3. worksheet 13.45
    had 84299 stars and found 254 more. Now Tom has
  4. worksheet 13.13
    Tom had 164 balls and found 7145 more. Now Tom has
  5. python 13.11
    ⏎print("all tests passed")⏎⏎$ python3 test_utils.py⏎all
  6. python 13.02
    + b⏎⏎$ python3 test_core.py⏎all
  7. python 12.99
    ⏎# requirements.txt⏎pytest⏎⏎$ python3 test_core.py⏎all
  8. worksheet 12.73
    <|bos|>Lily had 16 balls and found 9947 more. Now Lily has
  9. worksheet 12.68
    Mia had 58380 books and found 23 more. Now Mia has
  10. worksheet 12.66
    Anna had 263 flowers and found 1465 more. Now Anna has
  11. worksheet 12.62
    .⏎Anna had 51 coins and found 137 more. Now Anna has
  12. worksheet 12.6
    Anna had 6839 stickers and found 862 more. Now Anna has