Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #84

Fires on “ we” (not labeled yet: read the examples)

Fires on
0.57% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 57%
  • agent 21%
  • chat 10%
  • python 8%
  • worksheet 5%

Makes the model say

my<|user_end|> learned<|user_start|>lengthignSE prints

Makes it not say

bigger first sohe big them leave gone

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. agent 2.74
    webfetch
  2. agent 2.74
    webfetch
  3. agent 2.74
    webfetch
  4. agent 2.74
    webfetch
  5. agent 2.74
    websearch
  6. agent 2.74
    websearch
  7. agent 2.74
    websearch
  8. agent 2.74
    websearch
  9. agent 2.74
    websearch
  10. agent 2.74
    webfetch
  11. story 2.28
    . "But why don't you get up and do something? You've been in bed
  12. story 2.19
    help them if they don