Skip to content
mini-lab
Features of prelude-2

Feature #2953

Fires on “ it” (not labeled yet: read the examples)

Fires on
0.22% of tokens
Mostly in
python
Layer
after block 4

Where it fires

  • python 49%
  • agent 30%
  • story 17%
  • chat 2%
  • worksheet 2%

Makes the model say

FixednewkingoldStringail defines replaceRenamed

Makes it not say

. Tim them the even it happy

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 3.23
    it was beautiful and A
  2. story 3.23
    it would be fun to
  3. chat 3.23
    it to her friend,
  4. story 3.23
    it was worth it
  5. story 3.23
    it to play the dr
  6. story 3.23
    it is gone now."
  7. story 3.23
    it.⏎The end
  8. agent 3.23
    it"<|user_end|><|assistant_start|><|tool_call_start|>
  9. agent 3.23
    it<|user_end|><|assistant_start|><|tool_call_start|>s
  10. python 3.23
    it has `return len
  11. story 3.23
    it. So, they
  12. story 3.23
    it closer to her face