Skip to content
mini-lab
Features of prelude-2

Feature #166

Fires on “ do” (not labeled yet: read the examples)

Fires on
0.23% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 59%
  • chat 18%
  • agent 17%
  • worksheet 4%
  • python 2%

Makes the model say

next(se now with mean([ here

Makes it not say

$roTassertFix "!" sun⏎

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 6.56
    can only tell short stories and add numbers.<|assistant_end|><|user_start|>What can you do?<|user_end|><|assistant_start|>I
  2. chat 6.49
    can only tell short stories and add numbers.<|assistant_end|><|user_start|>What can you do?<|user_end|><|assistant_start|>I
  3. chat 6.35
    fix the Python files in this project.<|assistant_end|><|bos|><|user_start|>What can you do?<|user_end|><|assistant_start|>I
  4. agent 6.34
    in OpenCode, a coding agent harness.<|system_end|><|user_start|>"What can you do?"<|user_end|><|assistant_start|>I
  5. chat 6.27
    know how to tell stories and add numbers.<|assistant_end|><|user_start|>What can you do?<|user_end|><|assistant_start|>I
  6. chat 6.23
    know how to tell stories and add numbers.<|assistant_end|><|user_start|>What can you do?<|user_end|><|assistant_start|>I
  7. chat 6.19
    know how to tell stories and add numbers.<|assistant_end|><|user_start|>What can you do?<|user_end|><|assistant_start|>I
  8. chat 6.16
    <|assistant_start|>The answer is 698.<|assistant_end|><|user_start|>What can you do?<|user_end|><|assistant_start|>I
  9. chat 6.05
    The princess smiled and said "Hello, little puppy. What are you doing up here?" The
  10. chat 6.03
    the big rainbow.<|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>What can you do?<|user_end|><|assistant_start|>I
  11. story 5.99
    then his neighbor caught him in the act!⏎"What are you doing?" asked his neighbor
  12. chat 5.97
    a story, or some numbers to add?<|assistant_end|><|user_start|>What can you do?<|user_end|><|assistant_start|>I