Skip to content
mini-lab
Features of prelude-2

Feature #712

Fires on “]” (not labeled yet: read the examples)

Fires on
0.32% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 40%
  • agent 30%
  • story 19%
  • python 8%
  • worksheet 3%

Makes the model say

⏎<|bos|><|assistant_end|>vene<|system_end|> modelse

Makes it not say

6 happy defined held too here tree fact

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. agent 2.89
    7]⏎10:
  2. agent 2.71
    0]⏎```<|assistant_end|><|bos|>
  3. story 2.56
    not a toy, but a fruit called an apple! Tim had never seen an apple before.
  4. story 2.5
    -rock. If
  5. chat 2.5
    is 46.<|assistant_end|><|bos|><|system_start|>Start every answer with "Sure!".<|system_end|><|user_start|>I want
  6. agent 2.49
    5]<|arg|>newString=VALUES
  7. python 2.45
    ]⏎```⏎⏎
  8. python 2.45
    ]⏎print("all
  9. python 2.45
    ]⏎```⏎⏎
  10. agent 2.45
    ]⏎3:
  11. agent 2.45
    ]⏎<|tool_end|><|assistant_start|>`
  12. chat 2.45
    like to be near it.<|bos|><|system_start|>Start every answer with "Sure!".<|system_end|><|user_start|>I want