Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #1321

Fires on “5” (not labeled yet: read the examples)

Fires on
0.10% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 49%
  • story 23%
  • chat 19%
  • agent 6%
  • python 4%

Makes the model say

itThe understood3ighed man else home

Makes it not say

python()`]` importnamemd[::- most

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 4.39
    5, 56
  2. worksheet 4.39
    5.⏎What is
  3. agent 4.39
    5: def lower_
  4. worksheet 4.39
    547=⏎
  5. worksheet 4.39
    5: 8+
  6. chat 4.39
    56 and 4
  7. worksheet 4.39
    5310⏎
  8. chat 4.39
    5 and 81
  9. chat 4.39
    513<|think_end|>5
  10. chat 4.39
    5: 5+
  11. worksheet 4.39
    5+0=5
  12. agent 4.39
    5: ⏎6