Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #2579

Fires on “ code” (not labeled yet: read the examples)

Fires on
0.48% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 69%
  • chat 17%
  • story 9%
  • python 5%
  • worksheet 0%

Makes the model say

help any story( One hands wonderedaring

Makes it not say

k5# We You your I my

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. agent 3.38
    8]) == 4⏎ ^^^^^^^^^^^^^^^^^^^^^^^^⏎AssertionError⏎⏎Exited with code 1<|tool_end|><|assistant_start|>
  2. agent 3.34
    3]) == 9⏎ ^^^^^^^^^^^^^^^^^^^^^^^^^^^⏎AssertionError⏎⏎Exited with code 1<|tool_end|><|assistant_start|>
  3. agent 3.24
    == 5.25⏎ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^⏎AssertionError⏎⏎Exited with code 1<|tool_end|><|assistant_start|>
  4. agent 3.23
    18]⏎ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^⏎AssertionError⏎⏎Exited with code 1<|tool_end|><|assistant_start|>
  5. agent 3.23
    , 2]⏎ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^⏎AssertionError⏎⏎Exited with code 1<|tool_end|><|assistant_start|>
  6. agent 3.19
    18]⏎ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^⏎AssertionError⏎⏎Exited with code 1<|tool_end|><|assistant_start|>
  7. agent 3.17
    ) == 16⏎ ^^^^^^^^^^^^^^^^^⏎AssertionError⏎⏎Exited with code 1<|tool_end|><|assistant_start|>
  8. agent 3.15
    ]) == 7⏎ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^⏎AssertionError⏎⏎Exited with code 1<|tool_end|><|assistant_start|>
  9. agent 3.15
    code") == 2⏎ ^^^^^^^^^^^^^^^^^^^⏎AssertionError⏎⏎Exited with code 1<|tool_end|><|assistant_start|>
  10. agent 3.12
    ") == "duolc"⏎ ^^^^^^^^^^^^^^^^^^^^^^^^⏎AssertionError⏎⏎Exited with code 1<|tool_end|><|assistant_start|>
  11. agent 3.09
    4) == False⏎ ^^^^^^^^^^^^^^^^^^^^^^^⏎AssertionError⏎⏎Exited with code 1<|tool_end|><|assistant_start|>
  12. agent 3.08
    ") == 4⏎ ^^^^^^^^^^^^^^^^^^^^^^⏎AssertionError⏎⏎Exited with code 1<|tool_end|><|assistant_start|>