Skip to content
mini-lab
Features of prelude-2

Feature #3437

Fires on “ is” (not labeled yet: read the examples)

Fires on
0.45% of tokens
Mostly in
python
Layer
after block 4

Where it fires

  • python 45%
  • story 27%
  • chat 14%
  • agent 12%
  • worksheet 2%

Makes the model say

replaceAllmdopencode prelude belongN[li

Makes it not say

",," named?.( of

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 2.8
    .<|assistant_end|><|bos|><|user_start|>What is your name?<|user_end|><|assistant_start|>My name is prelude. I'm
  2. chat 2.65
    their feet.<|assistant_end|><|user_start|>What's your name?<|user_end|><|assistant_start|>My name is prelude. I'm
  3. chat 2.65
    ⏎```<|assistant_end|><|bos|><|user_start|>What is your name?<|user_end|><|assistant_start|>My name is prelude. I'm
  4. chat 2.53
    78.<|assistant_end|><|user_start|>Who are you?<|user_end|><|assistant_start|>My name is prelude. I'm
  5. chat 2.5
    4.<|assistant_end|><|user_start|>what's your name<|user_end|><|assistant_start|>My name is prelude. I'm
  6. chat 2.42
    appy to help!<|assistant_end|><|user_start|>Who made you?<|user_end|><|assistant_start|>My name is prelude. I'm
  7. chat 2.41
    treat you.<|bos|><|user_start|>What is your name?<|user_end|><|assistant_start|>My name is prelude. I'm
  8. chat 2.41
    again soon!"<|bos|><|user_start|>What is your name?<|user_end|><|assistant_start|>My name is prelude. I'm
  9. chat 2.39
    2.<|assistant_end|><|bos|><|user_start|>Tell me about yourself.<|user_end|><|assistant_start|>My name is prelude. I'm
  10. chat 2.39
    10.<|assistant_end|><|bos|><|user_start|>Who made you?<|user_end|><|assistant_start|>My name is prelude. I'm
  11. chat 2.35
    appy to help!<|assistant_end|><|user_start|>Who made you?<|user_end|><|assistant_start|>My name is prelude. I'm
  12. chat 2.31
    tools: calculator<|system_end|><|user_start|>What is your name?<|user_end|><|assistant_start|>My name is prelude. I'm