Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #2532

Fires on “ project” (not labeled yet: read the examples)

Fires on
0.80% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 90%
  • story 6%
  • chat 3%
  • python 1%
  • worksheet 0%

Makes the model say

<|tool_call_end|>oldStringreplaceAll()`.<|user_end|> "!"`. trained?

Makes it not say

we and big she other( like be

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. agent 2.98
    <|system_end|><|user_start|>Hello!<|user_end|><|assistant_start|>Hi! What should we do in this project?<|assistant_end|><|bos|>One
  2. agent 2.83
    <|user_start|>good morning<|user_end|><|assistant_start|>Hey! What should we do in this project?<|assistant_end|><|bos|>If
  3. agent 2.78
    good morning"<|user_end|><|assistant_start|>Hey! What should we do in this project?<|assistant_end|><|bos|><|system_start|>
  4. agent 2.77
    <|system_end|><|user_start|>Hey there<|user_end|><|assistant_start|>Hello! What should we do in this project?<|assistant_end|><|bos|><|system_start|>
  5. agent 2.74
    "yo"<|user_end|><|assistant_start|>Hey! What should we do in this project?<|assistant_end|><|bos|>Sam
  6. agent 2.61
    <|system_end|><|user_start|>hi<|user_end|><|assistant_start|>Hi! What should we do in this project?<|assistant_end|><|bos|><|user_start|>
  7. agent 2.6
    ob<|arg|>pattern=**/*.py<|tool_call_end|><|assistant_end|><|tool_start|>app.py<|tool_end|><|assistant_start|>This project has 1 Python
  8. agent 2.53
    <|assistant_end|><|user_start|>Hey there<|user_end|><|assistant_start|>Hello! What should we do in this project?<|assistant_end|><|bos|>`
  9. agent 2.47
    <|assistant_end|><|user_start|>Hello!<|user_end|><|assistant_start|>Hi! What should we do in this project?<|assistant_end|><|bos|>Once
  10. agent 2.43
    ob<|arg|>pattern=**/*.py<|tool_call_end|><|assistant_end|><|tool_start|>app.py<|tool_end|><|assistant_start|>This project has 1 Python
  11. agent 2.41
    ob<|arg|>pattern=**/*.py<|tool_call_end|><|assistant_end|><|tool_start|>main.py<|tool_end|><|assistant_start|>This project has 1 Python
  12. agent 2.41
    ob<|arg|>pattern=**/*.py<|tool_call_end|><|assistant_end|><|tool_start|>main.py<|tool_end|><|assistant_start|>This project has 1 Python