Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #181

Fires on “ has” (not labeled yet: read the examples)

Fires on
5.00% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 55%
  • chat 28%
  • python 7%
  • agent 7%
  • story 2%

Makes the model say

add python calculator<|assistant_start|> prelude passes up

Makes it not say

6 other32 goodbye5 x4

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 8.5
    9 + 640 = 649.⏎Mia has 858
  2. worksheet 8.26
    0 + 593 = 753.⏎Lucy has 280
  3. worksheet 8.05
    6 + 319 = 755.⏎Lucy has 260
  4. worksheet 7.96
    7957 = 7963.⏎Sue has 36 stickers
  5. worksheet 7.88
    2 + 306 = 358.⏎Sue has 474
  6. worksheet 7.87
    6 + 8 = 58254.⏎Sue has 87 apples
  7. worksheet 7.85
    0 + 104 = 564.⏎Mia has 305
  8. worksheet 7.8
    249, you get 7256.⏎Lucy has 962
  9. worksheet 7.75
    So 5 + 69 = 74.⏎Sue had 922
  10. worksheet 7.71
    ⏎So 5 + 5 = 10.⏎Max has 984
  11. worksheet 7.61
    5260 is 5266.⏎Lucy had 435
  12. worksheet 7.58
    4573 = 96815.⏎Lucy has 420