Skip to content
mini-lab
Features of prelude-2

Feature #142

Fires on “<|arg|>” (not labeled yet: read the examples)

Fires on
0.10% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 76%
  • story 20%
  • chat 4%
  • python 0%
  • worksheet 0%

Makes the model say

mpicitat kindus about

Makes it not say

<|assistant_end|> equals( lived +("_

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 1.85
    danced. She was very enthusiastic when she
  2. story 1.58
    a time there was a gray rabbit. The rabbit was very enthusiastic. Every
  3. story 1.52
    <|assistant_end|><|bos|>One day, a little boy named Tim was very enthusiastic. He
  4. story 1.46
    , there was a little dog named Max. Max was very enthusiastic. He
  5. agent 1.45
    <|assistant_end|><|user_start|>Where can I find shout?<|user_end|><|assistant_start|><|tool_call_start|>grep<|arg|>pattern=def shout
  6. story 1.44
    always wanted more and more. She did not like to share or say thank you. She did
  7. chat 1.43
    . But he felt a little guilty because he didn't say thank you to the bird
  8. agent 1.42
    <|user_start|>"Explain the function hello."<|user_end|><|assistant_start|><|tool_call_start|>grep<|arg|>pattern=def hello
  9. agent 1.38
    the function negate to new_negate"<|user_end|><|assistant_start|><|tool_call_start|>grep<|arg|>pattern=negate<|tool_call_end|>
  10. agent 1.38
    <|assistant_end|><|user_start|>Where can I find subtract?<|user_end|><|assistant_start|><|tool_call_start|>grep<|arg|>pattern=def subtract
  11. story 1.36
    <|bos|>Anna loved animals. She wanted to be a veterinarian when she grew
  12. agent 1.34
    <|user_start|>"Where can I find power?"<|user_end|><|assistant_start|><|tool_call_start|>grep<|arg|>pattern=def power