Skip to content
mini-lab
Features of prelude-2

Feature #490

Fires on “ can” (not labeled yet: read the examples)

Fires on
1.38% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 35%
  • chat 25%
  • story 19%
  • worksheet 12%
  • python 8%

Makes the model say

yourdy prelude accRenamed yourself need[-

Makes it not say

and0 fromco45:` went

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 3.43
    can you help me?<|user_end|>
  2. agent 3.43
    can you fix it?<|user_end|>
  3. agent 3.43
    can you fix it?<|user_end|>
  4. story 3.43
    can you help me shake the
  5. story 3.35
    help them if they don't know
  6. story 3.33
    play in the snow with
  7. story 2.82
    can be free and play
  8. agent 2.82
    can list, read,
  9. story 2.82
    can do special things."
  10. chat 2.82
    can only tell short stories
  11. chat 2.82
    can only tell short stories
  12. chat 2.82
    can't help with that