Skip to content
mini-lab
Features of prelude-2

Feature #2878

Fires on “.” (not labeled yet: read the examples)

Fires on
1.29% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 84%
  • chat 10%
  • story 4%
  • python 1%
  • worksheet 0%

Makes the model say

!")Rename tests defined Python list files code

Makes it not say

yisThank at tallse on laughing

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. agent 3.19
    Fix the bug in how_many, then check with test_items.py.<|user_end|><|assistant_start|>
  2. agent 3.14
    Fix the bug in upper_case, then check with test_text.py<|user_end|><|assistant_start|><|tool_call_start|>
  3. agent 3.14
    Fix the bug in num_chars, then check with test_greetings.py.<|user_end|><|assistant_start|>
  4. agent 3.13
    <|user_start|>Please fix the bug in triangle, then check with test_arith.py.<|user_end|><|assistant_start|>
  5. agent 3.0
    Fix the bug in first_letter, then check with test_strings.py.<|user_end|><|assistant_start|>
  6. agent 2.91
    Fix the bug in max_item, then check with test_lists.py.<|user_end|><|assistant_start|>
  7. agent 2.9
    fix the bug in how_many, then check with test_listlib.py.<|user_end|><|assistant_start|>
  8. agent 2.86
    <|system_end|><|user_start|>Fix the bug in vowels, then check with test_text.py.<|user_end|><|assistant_start|>
  9. agent 2.86
    Fix the bug in is_even, then check with test_lib.py.<|user_end|><|assistant_start|>
  10. agent 2.82
    Fix the bug in last_letter, then check with test_text.py.<|user_end|><|assistant_start|>
  11. agent 2.81
    Fix the bug in raise_to, then check with test_mathlib.py<|user_end|><|assistant_start|><|tool_call_start|>
  12. agent 2.81
    Fix the bug in has_item, then check with test_items.py."<|user_end|><|assistant_start|>