Skip to content
mini-lab
Features of prelude-2

Feature #560

Fires on “4” (not labeled yet: read the examples)

Fires on
0.19% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 62%
  • chat 14%
  • agent 12%
  • python 7%
  • story 4%

Makes the model say

'.iveOK Python`. [ient

Makes it not say

quiet So't sure walkedWhystwhisper

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 4.78
    4+82:
  2. chat 4.78
    44+25
  3. worksheet 4.78
    45⏎So
  4. agent 4.78
    4: print(mean
  5. worksheet 4.78
    47+03
  6. chat 4.78
    4.<|assistant_end|><|user_start|>what
  7. chat 4.78
    495<|assistant_end|><|bos|>
  8. chat 4.78
    4=11,
  9. worksheet 4.78
    43.⏎6
  10. chat 4.78
    4<|tool_end|><|assistant_start|>The answer
  11. agent 4.78
    4: acc =
  12. python 4.78
    4, 0]