Skip to content
mini-lab
Features of prelude-2

Feature #2273

Fires on “1” (not labeled yet: read the examples)

Fires on
0.77% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 36%
  • python 28%
  • chat 18%
  • worksheet 9%
  • story 9%

Makes the model say

. dream'sh saysive +

Makes it not say

stayedve wholeed proudaid dance own

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. python 3.91
    # README.md⏎#
  2. python 3.54
    )` returns the last letter of s.⏎⏎```
  3. python 3.4
    )` returns the first letter of s.⏎⏎```
  4. chat 3.25
    now?<|user_end|><|assistant_start|><|think_start|>2+8: 2+8=10, 1
  5. worksheet 3.23
    7: 3+7=10, 0
  6. worksheet 3.23
    7: 3+7=10, 0
  7. python 3.2
    `vowels(s)` counts the vowels in s.⏎⏎```
  8. worksheet 3.13
    277+7043: 7+3=10, 0
  9. chat 3.12
    <|think_start|>007+973: 7+3=10, 0
  10. worksheet 3.05
    94⏎48+92: 8+2=10, 0
  11. chat 3.05
    6⏎58+12: 8+2=10, 0
  12. chat 3.05
    now?<|user_end|><|assistant_start|><|think_start|>8+2: 8+2=10, 1