Skip to content
mini-lab
Features of prelude-2

Feature #1159

Fires on “ob” (not labeled yet: read the examples)

Fires on
1.96% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 62%
  • story 14%
  • python 13%
  • chat 8%
  • worksheet 2%

Makes the model say

isusersedobletter %and

Makes it not say

<|bos|> both⏎ two from all three

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. python 1.98
    (backwards("hello"))⏎⏎$ python3 main.py⏎olleh⏎
  2. agent 1.93
    .py⏎all tests passed⏎<|bos|><|system_start|>tools: edit, glob, grep,
  3. agent 1.89
    .py⏎all tests passed⏎<|bos|><|system_start|>tools: edit, glob, grep,
  4. python 1.86
    reversed. For example, `reverse("tiger")` returns `"regit"`.⏎⏎
  5. agent 1.85
    .py⏎all tests passed⏎<|bos|><|system_start|>tools: edit, glob, grep,
  6. agent 1.83
    .py⏎all tests passed⏎<|bos|><|system_start|>tools: edit, glob, grep,
  7. agent 1.82
    .py⏎all tests passed⏎<|bos|><|system_start|>tools: edit, glob, grep,
  8. agent 1.81
    .py⏎all tests passed⏎<|bos|><|system_start|>tools: edit, glob, grep,
  9. story 1.81
    Once upon a time, in a big tree, there was a bee hive. Many be
  10. python 1.81
    return s[-1]⏎⏎$ python3 demo.py⏎esuoh⏎o
  11. agent 1.8
    to `run.py`.<|assistant_end|><|bos|><|system_start|>tools: edit, glob, grep,
  12. agent 1.8
    .py⏎all tests passed⏎<|bos|><|system_start|>tools: edit, glob, grep,