Skip to content
mini-lab
Features of prelude-2

Feature #2172

Fires on “ with” (not labeled yet: read the examples)

Fires on
0.21% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 31%
  • python 25%
  • chat 24%
  • story 19%
  • worksheet 0%

Makes the model say

until other file Every timeOnceAfter their

Makes it not say

I might cannot could can off test friend

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 1.81
    eater. It was red and very warm. She wore it all the time. One day
  2. chat 1.81
    what it was like to be near it.<|bos|><|system_start|>Start every answer with "Sure!".<|system_end|>
  3. python 1.78
    ⏎```⏎⏎`excite` returns s with an exclamation mark. For example, `excite
  4. chat 1.77
    They knew they would be best friends forever.<|bos|><|system_start|>Start every answer with "Sure!".<|system_end|>
  5. story 1.77
    when she was sad, and when she was bored. She danced all the time.⏎One
  6. chat 1.76
    We can save some for the rabbit too."<|bos|><|system_start|>Start every answer with "Sure!".<|system_end|>
  7. chat 1.75
    The answer is 111.<|assistant_end|><|bos|><|system_start|>Start every answer with "Sure!".<|system_end|>
  8. python 1.74
    ⏎```⏎⏎`excite` returns s with an exclamation mark. For example, `excite
  9. python 1.73
    ⏎```⏎⏎`excite` returns s with an exclamation mark. For example, `excite
  10. chat 1.71
    <|tool_end|><|assistant_start|>Created `app.py`.<|assistant_end|><|bos|><|system_start|>Start every answer with "Sure!".<|system_end|>
  11. chat 1.71
    <|tool_end|><|assistant_start|>Created `run.py`.<|assistant_end|><|bos|><|system_start|>Start every answer with "Sure!".<|system_end|>
  12. chat 1.71
    49 = 8393.<|bos|><|system_start|>Start every answer with "Sure!".<|system_end|>