Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #144

Fires on “ what” (not labeled yet: read the examples)

Fires on
0.32% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 53%
  • chat 23%
  • worksheet 14%
  • story 9%
  • python 2%

Makes the model say

in join Now enough that min bettermin

Makes it not say

#!")")")`toople listtriangle

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 6.32
    1537 = 1556.⏎Hey, what's 7 plus
  2. worksheet 6.29
    + 252 = 261.⏎Hey, what's 4 plus
  3. worksheet 6.28
    + 73 = 8880.⏎Hey, what's 4 plus
  4. worksheet 6.25
    879 = 10564.⏎Hey, what's 28
  5. worksheet 6.2
    + 1 = 40379.⏎Hey, what's 40
  6. worksheet 6.05
    124 = 68132.⏎Hey, what's 42
  7. worksheet 6.05
    4626 = 4626⏎Hey, what's 1 plus
  8. worksheet 6.0
    79, you get 1044.⏎Hey, what's 58
  9. worksheet 5.94
    8547 = 9536.⏎Hey, what's 10
  10. worksheet 5.94
    652 = 29657.⏎Hey, what's 64
  11. worksheet 5.89
    + 399 = 595.⏎Hey, what's 23
  12. worksheet 5.86
    816 = 80338.⏎Hey, what's 67