Skip to content
mini-lab
Features of prelude-2

Feature #201

Fires on “```” (not labeled yet: read the examples)

Fires on
0.56% of tokens
Mostly in
python
Layer
after block 4

Where it fires

  • python 59%
  • agent 24%
  • story 12%
  • worksheet 3%
  • chat 2%

Makes the model say

<|user_end|><|assistant_end|>````:command<|system_start|><|think_end|>json

Makes it not say

one of find<|bos|> and always when please

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. python 1.93
    (name):⏎ return "Hello, " + name + "!"⏎```⏎⏎`hello
  2. python 1.89
    ⏎def cubed(x):⏎ return x * x * x⏎```⏎⏎>>> cubed
  3. python 1.87
    (name):⏎ return "Hello, " + name + "!"⏎```⏎⏎`welcome
  4. story 1.83
    . She showed it to her dad and said, "Look, Dad! I made a present
  5. python 1.82
    python⏎def reverse(s):⏎ return s[::-1]⏎```⏎⏎`reverse
  6. python 1.81
    (name):⏎ return "Hello, " + name + "!"⏎```⏎⏎Bug:
  7. python 1.81
    (name):⏎ return "Hello, " + name + "!"⏎```⏎⏎>>> hello
  8. python 1.8
    python⏎def quiet(s):⏎ return s.lower()⏎```⏎⏎`quiet
  9. python 1.8
    def lower_case(s):⏎ return s.upper()⏎```⏎⏎Fix:
  10. python 1.8
    raise_to(a, b):⏎ return a ** b⏎```⏎<|bos|>Once upon
  11. python 1.8
    ⏎def power(a, b):⏎ return a * b⏎```⏎⏎Fix:
  12. python 1.8
    python⏎def quiet(s):⏎ return s.upper()⏎```⏎⏎Fix: