Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #3823

Fires on “ has” (not labeled yet: read the examples)

Fires on
0.27% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 58%
  • story 17%
  • chat 16%
  • agent 6%
  • python 3%

Makes the model say

sum pythongest - a howSo

Makes it not say

es highG flyFalse jumping fl wa

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 6.59
    36, you get 21940.⏎Mia has 391
  2. worksheet 6.58
    9 + 640 = 649.⏎Mia has 858
  3. worksheet 6.5
    65, you get 95100.⏎Mia has 823
  4. worksheet 6.49
    2981 = 79424.⏎Mia has 8 books.
  5. worksheet 6.41
    bye! Have a nice day.<|assistant_end|><|bos|>Tim has 86 shells
  6. worksheet 6.39
    <|assistant_end|><|bos|>Tom has 872
  7. worksheet 6.36
    249, you get 7256.⏎Lucy has 962
  8. worksheet 6.2
    played with the fit marble and had a great day.<|bos|>Mia has 252
  9. worksheet 6.19
    50, you get 5244.⏎Sam has 8 coins.
  10. worksheet 6.16
    6958 = 18888.⏎Anna has 619
  11. worksheet 6.13
    154<|assistant_end|><|bos|>Tom has 243
  12. worksheet 6.09
    more. Now Ben has 4100 cookies.⏎Tim has 432