Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #4007

Fires on “:” (not labeled yet: read the examples)

Fires on
2.06% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 73%
  • chat 12%
  • worksheet 6%
  • python 6%
  • story 2%

Makes the model say

replace calculator ` " there_<|assistant_end|>()`

Makes it not say

? return."d?" bird so very

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. agent 8.48
    <|bos|><|system_start|>tools: edit, glob
  2. chat 8.48
    <|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>Can
  3. chat 8.48
    <|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>Can
  4. agent 8.48
    <|bos|><|system_start|>tools: edit, glob
  5. agent 8.43
    happy and grateful for the new friends.<|bos|><|system_start|>tools: edit, glob
  6. agent 8.39
    been gifted the key to her very own garden!<|bos|><|system_start|>tools: edit, glob
  7. agent 8.34
    . That way, you will stay safe and happy.<|bos|><|system_start|>tools: edit, glob
  8. chat 8.33
    ant capabilities<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>Find
  9. agent 8.33
    Everyone was happy and had a great time.<|bos|><|system_start|>tools: edit, glob
  10. agent 8.28
    ⏎all tests passed⏎<|bos|><|system_start|>tools: edit, glob
  11. chat 8.27
    laughed. And they lived happily ever after.<|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>How
  12. agent 8.24
    is as important as sharing your own talents.<|bos|><|system_start|>tools: edit, glob