Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #217

Fires on “Bug” (not labeled yet: read the examples)

Fires on
0.57% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 52%
  • python 23%
  • chat 18%
  • story 6%
  • worksheet 1%

Makes the model say

Once<|arg|>de listitedNAareverse

Makes it not say

surprise Theyred⏎divides `r The

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. python 4.58
    <|bos|>Bug: `max_
  2. python 4.58
    <|bos|>Bug: `add`
  3. python 4.33
    ```⏎<|bos|>Bug: `mean_
  4. python 4.26
    ⏎code!⏎ROBOT⏎```<|assistant_end|><|bos|>Bug: `average_
  5. python 3.88
    model: I can only tell short stories and add numbers.<|assistant_end|><|bos|>Bug: `lower_
  6. python 3.82
    56<|tool_end|><|assistant_start|>The answer is 756.<|assistant_end|><|bos|>Bug: `max_
  7. python 3.81
    The answer is 14.<|assistant_end|><|bos|>Bug: `mean`
  8. python 3.79
    , thanks!<|user_end|><|assistant_start|>Sure! You're welcome!<|assistant_end|><|bos|>Bug: `average_
  9. python 3.76
    oes and saving the day.<|bos|>Bug: `increment`
  10. python 3.74
    rest under the tree, wearing their matching gray shoes.<|assistant_end|><|bos|>Bug: `product`
  11. agent 3.68
    677 equals 714.<|bos|><|system_start|>tools: edit, gl
  12. python 3.67
    46799 = 95095.<|bos|>Bug: `flip`