Skip to content
mini-lab
Features of prelude-2

Feature #3162

Fires on “_” (not labeled yet: read the examples)

Fires on
0.72% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 56%
  • worksheet 17%
  • python 13%
  • chat 12%
  • story 2%

Makes the model say

utils19etoo itsrun(

Makes it not say

<|assistant_end|><|bos|> let only$",Goodood

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 3.32
    in the park with their gray dog, Max. They like to play hide and seek with Max
  2. python 3.3
    only tell short stories and add numbers.<|assistant_end|><|bos|># test_number_utils.py⏎
  3. story 3.2
    <|assistant_end|><|bos|>Lily and Ben are brother and sister. They like to play hide and seek on Su
  4. story 3.19
    the park and in the house. One day, they decided to play hide and seek. Lily
  5. agent 3.15
    title generator.<|system_end|><|user_start|>fix the bug caught by test_math_utils.py.
  6. agent 3.14
    a coding agent harness.<|system_end|><|user_start|>Run the tests in test_math_utils.py.
  7. python 3.07
    [-1]`. The tests pass now.<|assistant_end|><|bos|># test_math_utils.py⏎
  8. python 2.97
    studied the forest together every day.<|bos|># test_number_utils.py⏎
  9. agent 2.93
    in OpenCode, a coding agent harness.<|system_end|><|user_start|>Make test_math_utils.py pass
  10. story 2.85
    time, there was a little girl named Lily. She liked to play hide and seek with her
  11. story 2.83
    time, there was a little girl named Lily. She loved to play hide and seek with her
  12. agent 2.82
    rite<|arg|>path=number_utils.py<|arg|>