Skip to content
mini-lab
Features of prelude-2

Feature #557

Fires on “```” (not labeled yet: read the examples)

Fires on
0.73% of tokens
Mostly in
python
Layer
after block 4

Where it fires

  • python 74%
  • agent 22%
  • story 2%
  • chat 1%
  • worksheet 0%

Makes the model say

python<|assistant_end|>ationtxt readyOnce lateely

Makes it not say

ifle- hugged small window sharp also

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. python 7.31
    ⏎```⏎⏎>>> evens
  2. python 7.31
    ⏎```⏎⏎`sub
  3. agent 7.31
    ⏎```⏎2⏎```
  4. agent 7.31
    ⏎```⏎False⏎1
  5. agent 7.31
    ⏎```⏎True⏎```
  6. agent 7.31
    ⏎```<|assistant_end|><|bos|>One day
  7. python 7.31
    ⏎```python⏎def subtract
  8. python 7.31
    ⏎```python⏎def exclaim
  9. python 7.31
    ⏎```⏎⏎Bug:
  10. agent 7.31
    ⏎```<|assistant_end|><|bos|><|system_start|>Answer
  11. python 7.31
    ⏎```python⏎def first
  12. python 7.31
    ⏎```python⏎def combine