Skip to content
mini-lab
Features of prelude-2

Feature #1526

Fires on “ a” (not labeled yet: read the examples)

Fires on
0.41% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 39%
  • worksheet 34%
  • agent 20%
  • story 5%
  • python 2%

Makes the model say

146593 darkou

Makes it not say

. soon]))!")They princess(⏎⏎

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 2.99
    `.<|assistant_end|><|bos|><|system_start|>Answer in one short sentence.<|system_end|><|user_start|>Tell me a story.<|user_end|><|assistant_start|>
  2. chat 2.97
    friends.<|bos|><|system_start|>Answer in one short sentence.<|system_end|><|user_start|>Tell me a story about a cat
  3. chat 2.95
    passed⏎<|bos|><|system_start|>Answer in one short sentence.<|system_end|><|user_start|>Tell me a story.<|user_end|><|assistant_start|>
  4. chat 2.94
    .py` and `lists.py`.<|assistant_end|><|bos|><|user_start|>Tell me a story.<|user_end|><|assistant_start|>
  5. chat 2.93
    `.<|assistant_end|><|bos|><|system_start|>Answer in one short sentence.<|system_end|><|user_start|>Tell me a short story.<|user_end|>
  6. chat 2.93
    .<|assistant_end|><|bos|><|system_start|>Answer in one short sentence.<|system_end|><|user_start|>Tell me a story.<|user_end|><|assistant_start|>
  7. chat 2.92
    `.<|assistant_end|><|bos|><|system_start|>Answer in one short sentence.<|system_end|><|user_start|>Tell me a story about a fish
  8. agent 2.92
    agent running in OpenCode, a coding agent harness.<|system_end|><|user_start|>Please write a script hello.py
  9. chat 2.91
    can learn and have fun at the same time.<|bos|><|user_start|>Tell me a fact about space.
  10. agent 2.91
    agent running in OpenCode, a coding agent harness.<|system_end|><|user_start|>Please write a new function head in
  11. chat 2.9
    .<|assistant_end|><|bos|><|system_start|>Start every answer with "Sure!".<|system_end|><|user_start|>Write a short story about a
  12. chat 2.9
    while, they forgot about the war and were happy.<|bos|><|user_start|>Write a story for me.