Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #1396

Fires on “ line” (not labeled yet: read the examples)

Fires on
0.28% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 62%
  • story 23%
  • chat 12%
  • worksheet 1%
  • python 1%

Makes the model say

<|tool_call_end|> back you down<|assistant_end|> by main replied

Makes it not say

testsccharsmyv birdsorRun

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. agent 2.9
    call last):⏎ File "app.py", line 4, in
  2. agent 2.63
    call last):⏎ File "test_greetings.py", line 3, in
  3. agent 2.62
    last):⏎ File "test_strings.py", line 3, in
  4. agent 2.52
    ):⏎ File "test_textlib.py", line 6, in
  5. agent 2.5
    most recent call last):⏎ File "test_text.py", line 3, in
  6. agent 2.49
    Traceback (most recent call last):⏎ File "run.py", line 4, in
  7. agent 2.49
    Traceback (most recent call last):⏎ File "run.py", line 5, in
  8. agent 2.49
    most recent call last):⏎ File "test_tools.py", line 5, in
  9. agent 2.49
    most recent call last):⏎ File "test_mathlib.py", line 3, in
  10. agent 2.48
    most recent call last):⏎ File "test_helpers.py", line 5, in
  11. agent 2.47
    most recent call last):⏎ File "test_ops.py", line 3, in
  12. agent 2.46
    most recent call last):⏎ File "test_tools.py", line 3, in