Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #2323

Fires on “:” (not labeled yet: read the examples)

Fires on
0.14% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 78%
  • python 8%
  • chat 7%
  • story 5%
  • worksheet 2%

Makes the model say

`]`. birds owl5```1json

Makes it not say

also tablereSoon even One surprise kept

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. agent 2.31
    test_lib.py<|tool_end|><|assistant_start|>This project has 3 Python files: `main.py
  2. agent 2.26
    test_stats.py<|tool_end|><|assistant_start|>This project has 4 Python files: `stats.py
  3. agent 2.26
    py⏎demo.py<|tool_end|><|assistant_start|>This project has 4 Python files: `arith.py
  4. agent 2.25
    py⏎listlib.py<|tool_end|><|assistant_start|>This project has 3 Python files: `hello.py
  5. agent 2.19
    py⏎script.py<|tool_end|><|assistant_start|>This project has 4 Python files: `text.py
  6. agent 2.17
    py⏎calc.py<|tool_end|><|assistant_start|>This project has 5 Python files: `test_lib
  7. agent 2.16
    py⏎main.py<|tool_end|><|assistant_start|>This project has 4 Python files: `test_items
  8. agent 2.13
    test_words.py<|tool_end|><|assistant_start|>This project has 4 Python files: `words.py
  9. agent 2.13
    py⏎words.py<|tool_end|><|assistant_start|>This project has 4 Python files: `hello.py
  10. agent 2.12
    py⏎words.py<|tool_end|><|assistant_start|>This project has 4 Python files: `test_words
  11. agent 2.11
    py⏎script.py<|tool_end|><|assistant_start|>This project has 4 Python files: `textlib.py
  12. agent 2.1
    test_items.py<|tool_end|><|assistant_start|>This project has 5 Python files: `main.py