Skip to content
mini-lab
Features of prelude-2

Feature #3467

Fires on “ch” (not labeled yet: read the examples)

Fires on
0.33% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 92%
  • story 6%
  • chat 1%
  • worksheet 0%
  • python 0%

Makes the model say

MThank f eakl<|assistant_end|> back

Makes it not say

treeOne: onew smelleditem living

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. agent 2.41
    , shell, skill, subagent, webfetch, webse
  2. agent 2.38
    , shell, skill, subagent, webfetch, webse
  3. agent 2.38
    , shell, skill, subagent, webfetch, webse
  4. agent 2.37
    , shell, skill, subagent, webfetch, webse
  5. agent 2.37
    , shell, skill, subagent, webfetch, webse
  6. agent 2.37
    , shell, skill, subagent, webfetch, webse
  7. agent 2.36
    , shell, skill, subagent, webfetch, webse
  8. agent 2.36
    , shell, skill, subagent, webfetch, webse
  9. agent 2.36
    , shell, skill, subagent, webfetch, webse
  10. agent 2.36
    , shell, skill, subagent, webfetch, webse
  11. agent 2.36
    , shell, skill, subagent, webfetch, webse
  12. agent 2.36
    , shell, skill, subagent, webfetch, webse