Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #1304

Fires on “,” (not labeled yet: read the examples)

Fires on
1.07% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 87%
  • story 10%
  • python 2%
  • chat 1%
  • worksheet 0%

Makes the model say

and but bag for." who too park

Makes it not say

stRenameoldStringCreateddoublemdnumber

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 2.55
    cards, and toys with paper, crayons, and glue. One
  2. agent 2.5
    , read, shell, skill, subagent,
  3. agent 2.5
    , read, shell, skill, subagent,
  4. agent 2.5
    , read, shell, skill, subagent,
  5. agent 2.5
    , read, shell, skill, subagent,
  6. agent 2.5
    , read, shell, skill, subagent,
  7. agent 2.5
    , read, shell, skill, subagent,
  8. agent 2.5
    , read, shell, skill, subagent,
  9. agent 2.5
    , read, shell, skill, subagent,
  10. story 2.46
    .⏎Bow looked under the big tree, behind the red ball, and even in the
  11. agent 2.45
    , question, read, shell, skill, subagent,
  12. agent 2.45
    , question, read, shell, skill, subagent,