Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #873

Fires on “ not” (not labeled yet: read the examples)

Fires on
0.50% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 30%
  • python 29%
  • story 21%
  • chat 18%
  • worksheet 3%

Makes the model say

1 floor notdefg want liked wanted

Makes it not say

<|tool_call_start|> plus<|user_start|> mini<|think_start|>replaceAllschema (

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 3.47
    and brought back to the house.⏎Bill thanked his neighbor for the invitation
  2. chat 3.3
    172.<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|system_start|>Do not use the calculator.
  3. chat 3.27
    for another story soon.<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|system_start|>Do not use the calculator.
  4. chat 3.27
    to tell his friends.<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|system_start|>Do not use the calculator.
  5. chat 3.26
    hard work they had done!<|bos|><|system_start|>tools: calculator<|system_end|><|system_start|>Do not use the calculator.
  6. story 3.24
    tasted it and it was very sweet. He was happy and thanked Jerry for helping him. From
  7. chat 3.21
    that dreams can come true.<|bos|><|system_start|>tools: calculator<|system_end|><|system_start|>Do not use the calculator.
  8. chat 3.16
    _utils.py`.<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|system_start|>Do not use the calculator.
  9. chat 3.13
    the meadow some more.<|bos|><|system_start|>tools: calculator<|system_end|><|system_start|>Do not use the calculator.
  10. chat 3.13
    4<|think_end|>394<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|system_start|>Do not use the calculator.
  11. chat 3.13
    other when things were hard.<|bos|><|system_start|>tools: calculator<|system_end|><|system_start|>Do not use the calculator.
  12. chat 3.12
    me for a story!<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|system_start|>Do not use the calculator.