Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #3040

Fires on “mean” (not labeled yet: read the examples)

Fires on
0.53% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 47%
  • python 41%
  • story 8%
  • chat 3%
  • worksheet 1%

Makes the model say

_` sure an that a("ant

Makes it not say

<|assistant_end|>akefinal We done greeting<|tool_call_end|> files

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. python 4.43
    The answer is 14.<|assistant_end|><|bos|>Bug: `mean` should return the
  2. python 4.28
    ```⏎<|bos|>Bug: `mean_list` should
  3. python 4.27
    !⏎ROBOT⏎```<|assistant_end|><|bos|>Bug: `average_list` should
  4. python 4.17
    the next time he could go to the park.<|bos|>Bug: `average_list` should
  5. python 4.13
    !<|user_end|><|assistant_start|>Sure! You're welcome!<|assistant_end|><|bos|>Bug: `average_list` should
  6. python 4.08
    test_utils.py⏎all tests passed⏎<|bos|>Bug: `mean_list` should
  7. python 4.08
    ):⏎ return items[0]⏎```⏎⏎Bug: `mean_list` should
  8. python 4.02
    , 693<|think_end|>693<|assistant_end|><|bos|>Bug: `average` should return the
  9. python 3.85
    ):⏎ return len(items)⏎```⏎⏎Bug: `average_list` should
  10. python 3.8
    ⏎ return x * x * x⏎```⏎⏎Bug: `mean` should return the
  11. python 3.77
    ):⏎ return items[0]⏎```⏎⏎Bug: `double` should return x
  12. python 3.75
    Bug: `mean_list` should