Skip to content
mini-lab
Features of prelude-2

Feature #599

Fires on “⏎” (not labeled yet: read the examples)

Fires on
1.48% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 51%
  • python 30%
  • worksheet 14%
  • story 3%
  • chat 2%

Makes the model say

<|bos|>assert```⏎ course lesson<|user_start|>$

Makes it not say

of for more, adds cut lot box

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. python 6.36
    $ python3 main.py⏎40⏎12⏎<|bos|><|system_start|>tools:
  2. python 6.31
    ⏎⏎$ python3 main.py⏎code cloud⏎1⏎<|bos|># LICENSE⏎
  3. python 6.13
    python3 script.py⏎robot sun⏎2⏎144⏎$ python3 test
  4. python 6.06
    ⏎⏎$ python3 main.py⏎5⏎8⏎4⏎$ python3 test
  5. python 6.04
    $ python3 main.py⏎24⏎5⏎-1⏎<|bos|># lib.
  6. python 5.93
    $ python3 main.py⏎4⏎$ python3 test
  7. python 5.93
    ]))⏎⏎$ python3 hello.py⏎8⏎17⏎<|bos|><|system_start|>tools:
  8. python 5.87
    ")⏎⏎$ python3 app.py⏎2⏎-2⏎$ python3 test
  9. python 5.84
    $ python3 main.py⏎5.0⏎729⏎False⏎$ python
  10. python 5.8
    ⏎⏎$ python3 main.py⏎8⏎<|bos|><|system_start|>tools:
  11. python 5.78
    tests⏎⏎$ python3 run.py⏎17⏎$ python3 test
  12. python 5.68
    ⏎True⏎[0, 16, 14]⏎$ python3 test