Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #432

Fires on “AssertionError” (not labeled yet: read the examples)

Fires on
1.39% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 76%
  • chat 12%
  • story 7%
  • worksheet 4%
  • python 1%

Makes the model say

Fixed=**/Sorryre<|arg|>lyCreated NUMBER

Makes it not say

,. Tim happy soft5 help big

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. agent 2.41
    ⏎ ^^^^^^^^^^^^^^^^^^^^^^⏎AssertionError⏎⏎Exited with
  2. agent 2.31
    == -12⏎ ^^^^^^^^^^^^^^^^^^^⏎AssertionError⏎⏎Exited with
  3. agent 2.19
    num_chars("tree") == 4⏎ ^^^^^^^^^^^^^^^^^^^^^^⏎AssertionError⏎⏎Exited with
  4. agent 2.19
    ) == 1000⏎ ^^^^^^^^^^^^^^^^^⏎AssertionError⏎⏎Exited with code 1
  5. agent 2.18
    ^^⏎AssertionError⏎⏎Exited with
  6. agent 2.14
    assert previous(11) == 10⏎ ^^^^^^^^^^^^^^^^^^⏎AssertionError⏎⏎Exited with
  7. agent 2.09
    ^^^⏎AssertionError⏎⏎Exited with
  8. agent 2.08
    7, 4) == False⏎ ^^^^^^^^^^^^^^^^^^^^^^^⏎AssertionError⏎⏎Exited with code 1
  9. chat 2.07
    things seem bad, they can turn out to be good.<|bos|><|system_start|>Answer with the number only
  10. agent 2.06
    (3, 11) == -8⏎ ^^^^^^^^^^^^^^^^^^⏎AssertionError⏎⏎Exited with
  11. chat 2.06
    she learned something new with her mom.<|bos|><|system_start|>Answer with the number only
  12. chat 2.04
    best treasure hunters in the world.<|bos|><|system_start|>Answer in one short sentence