Skip to content
mini-lab
Features of prelude-2

Feature #2581

Fires on “txt” (not labeled yet: read the examples)

Fires on
1.04% of tokens
Mostly in
python
Layer
after block 4

Where it fires

  • python 59%
  • agent 37%
  • story 1%
  • worksheet 1%
  • chat 1%

Makes the model say

"))`,")!")⏎"`.= ==

Makes it not say

niceassert>>>2ked something he kind

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. python 3.84
    popular.<|assistant_end|><|bos|># notes.txt⏎Remember to
  2. python 3.71
    ]⏎print("all tests passed")⏎⏎# notes.txt⏎Remember to
  3. python 3.67
    Demo⏎⏎A small Python project.⏎⏎# notes.txt⏎TOD
  4. python 3.61
    ing what you need is a useful life lesson!<|bos|># notes.txt⏎TOD
  5. python 3.6
    ⏎# opencode.json⏎{⏎ "$
  6. python 3.59
    cratch⏎⏎A small Python project.⏎⏎# notes.txt⏎TOD
  7. python 3.58
    ⏎⏎# README.md⏎# Calculator
  8. python 3.55
    today?<|assistant_end|><|bos|># opencode.json⏎{⏎ "$
  9. python 3.48
    ! The answer is 167.<|assistant_end|><|bos|># requirements.txt⏎pytest⏎⏎
  10. python 3.45
    (items)` to `main.py`.<|assistant_end|><|bos|># README.md⏎# Tiny utils
  11. python 3.44
    9⏎print("all tests passed")⏎⏎# requirements.txt⏎pytest⏎⏎
  12. python 3.42
    3 main.py⏎4⏎$ python3 test_tools.py⏎all tests passed