Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #2854

Fires on “5” (not labeled yet: read the examples)

Fires on
0.18% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 37%
  • chat 25%
  • agent 18%
  • story 14%
  • python 5%

Makes the model say

named / became because some livedhas by

Makes it not say

' <|think_start|>head surprise".NameError car

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 2.54
    5, 56
  2. worksheet 2.54
    5.⏎What is
  3. agent 2.54
    5: def lower_
  4. worksheet 2.54
    547=⏎
  5. worksheet 2.54
    5: 8+
  6. chat 2.54
    56 and 4
  7. worksheet 2.54
    5310⏎
  8. chat 2.54
    5 and 81
  9. chat 2.54
    513<|think_end|>5
  10. chat 2.54
    5: 5+
  11. worksheet 2.54
    5+0=5
  12. agent 2.54
    5: ⏎6