Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #973

Fires on “7” (not labeled yet: read the examples)

Fires on
0.86% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 42%
  • agent 34%
  • chat 13%
  • python 9%
  • story 2%

Makes the model say

48One goodbyeis5pylower

Makes it not say

!()` " `<|assistant_end|> when⏎ https

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 3.5
    = 654.⏎If you add 1 and 341, you
  2. worksheet 3.5
    9003.⏎If you add 7 and 37648
  3. worksheet 3.4
    5.⏎If you add 83817 and 73050
  4. worksheet 3.38
    10561.⏎If you add 7 and 6, you get
  5. worksheet 3.37
    49295.⏎If you add 7 and 7249,
  6. worksheet 3.34
    85864.⏎If you add 5 and 896, you
  7. worksheet 3.33
    7964.⏎If you add 9 and 840, you
  8. worksheet 3.32
    3.⏎If you add 72342 and 66, you get
  9. worksheet 3.31
    9.⏎If you add 18879 and 56, you get
  10. worksheet 3.3
    0 = 3.⏎If you add 4 and 6989,
  11. worksheet 3.28
    seeing the pretty glow.<|bos|>If you add 6 and 7493,
  12. worksheet 3.27
    9 = 91.⏎If you add 3 and 88341