Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #648

Fires on “,” (not labeled yet: read the examples)

Fires on
0.44% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 60%
  • python 31%
  • chat 6%
  • story 2%
  • worksheet 0%

Makes the model say

replace by wind valuefort wear play

Makes it not say

⏎I Thistools" arrivedYou laptop

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. agent 3.79
    much.<|bos|><|system_start|>tools: edit, glob, gre
  2. agent 3.72
    even more fun.<|bos|><|system_start|>tools: edit, glob, gre
  3. agent 3.65
    happy and grateful for the new friends.<|bos|><|system_start|>tools: edit, glob, gre
  4. agent 3.63
    108.<|bos|><|system_start|>tools: edit, glob, gre
  5. agent 3.63
    !<|bos|><|system_start|>tools: edit, glob, gre
  6. agent 3.61
    5862.<|bos|><|system_start|>tools: edit, glob, gre
  7. agent 3.61
    ```<|assistant_end|><|bos|><|system_start|>tools: edit, glob, gre
  8. agent 3.61
    ```<|assistant_end|><|bos|><|system_start|>tools: edit, glob, gre
  9. agent 3.61
    ```<|assistant_end|><|bos|><|system_start|>tools: edit, glob, gre
  10. agent 3.6
    stories and add numbers.<|assistant_end|><|bos|><|system_start|>tools: edit, glob, gre
  11. agent 3.58
    The answer is 766.<|assistant_end|><|bos|><|system_start|>tools: edit, glob, gre
  12. agent 3.57
    ):⏎ return a ** b⏎```⏎<|bos|><|system_start|>tools: edit, glob, gre