Skip to content
mini-lab
Features of prelude-2

Feature #3543

Fires on “ with” (not labeled yet: read the examples)

Fires on
0.47% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 48%
  • chat 36%
  • story 13%
  • python 2%
  • worksheet 0%

Makes the model say

a the all how be what loud `

Makes it not say

ientlower don]K element hid<|arg|>

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 3.38
    1522 is 1534.<|bos|><|system_start|>Answer with the number only.
  2. chat 3.38
    36 = 98926.<|bos|><|system_start|>Answer with the number only.
  3. agent 3.37
    OpenCode, a coding agent harness.<|system_end|><|user_start|>"Add sum_to to calc.py:
  4. chat 3.36
    she learned something new with her mom.<|bos|><|system_start|>Answer with the number only.
  5. chat 3.33
    3195 = 3202.<|bos|><|system_start|>Answer with the number only.
  6. chat 3.3
    76 = 66264.<|bos|><|system_start|>Answer in one short sentence.
  7. chat 3.3
    5183 = 5190.<|bos|><|system_start|>Answer with the number only.
  8. agent 3.29
    agent running in OpenCode, a coding agent harness.<|system_end|><|user_start|>Add doubled to utils.py:
  9. agent 3.29
    in OpenCode, a coding agent harness.<|system_end|><|user_start|>Add min_of to app.py:
  10. chat 3.26
    499 = 27505.<|bos|><|system_start|>Answer with the number only.
  11. chat 3.24
    a fun day playing together with the red wagon.<|assistant_end|><|bos|><|system_start|>Answer with the number only.
  12. chat 3.24
    34 is 130527.<|bos|><|system_start|>Answer with the number only.