Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #925

Fires on “```” (not labeled yet: read the examples)

Fires on
0.27% of tokens
Mostly in
python
Layer
after block 4

Where it fires

  • python 73%
  • agent 20%
  • story 4%
  • chat 2%
  • worksheet 1%

Makes the model say

python<|assistant_end|>calculator<|system_start|>minathow

Makes it not say

watch cookies room.? family smallest But

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. python 3.42
    main.py⏎ROBOT⏎78⏎<|bos|>```python⏎def mean
  2. python 3.42
    14, 2, 14]`.⏎⏎```python⏎def max
  3. python 3.29
    ])` returns `4`.⏎⏎```python⏎def only
  4. python 3.2
    `0`.⏎⏎```python⏎def tail
  5. agent 3.12
    ⏎0⏎7⏎```<|assistant_end|><|bos|>Once upon
  6. python 3.11
    , 4, 4, 2])⏎4⏎<|bos|>```python⏎def odd
  7. python 3.11
    6])` returns `6`.⏎⏎```python⏎def mean
  8. python 3.09
    , 10, 2, 10]⏎⏎```python⏎def head
  9. python 3.07
    n in nums if n % 2 == 1]`.⏎⏎```python⏎def only
  10. python 3.06
    absolute(-4)` returns `4`.⏎⏎```python⏎def exclaim
  11. agent 3.05
    ⏎4⏎```<|assistant_end|><|bos|>Once upon
  12. agent 3.05
    ⏎4⏎```<|assistant_end|><|user_start|>are you