Skip to content
mini-lab
Features of prelude-2

Feature #3587

Fires on “<|bos|>” (not labeled yet: read the examples)

Fires on
1.12% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 32%
  • agent 25%
  • story 24%
  • python 10%
  • worksheet 9%

Makes the model say

return<|think_end|>= Max whether")`<|user_start|>:

Makes it not say

b just next new two play himcount

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 15.43
    they had a fun day playing with the treasure in the park.<|assistant_end|><|bos|>Once upon a time
  2. agent 15.34
    <|tool_call_end|><|assistant_end|><|tool_start|>all tests passed⏎<|tool_end|><|assistant_start|>All tests pass.<|assistant_end|><|bos|><|system_start|>tools: edit
  3. agent 15.31
    <|tool_call_end|><|assistant_end|><|tool_start|>all tests passed⏎<|tool_end|><|assistant_start|>All tests pass.<|assistant_end|><|bos|><|system_start|>tools: edit
  4. chat 15.3
    Tom went home to rest after their fun day at the beach.<|assistant_end|><|bos|><|user_start|>Add 2
  5. story 15.26
    very good. Tim and Sue were happy they played the game.<|assistant_end|><|bos|>Johnny was three
  6. agent 15.21
    <|tool_call_end|><|assistant_end|><|tool_start|>all tests passed⏎<|tool_end|><|assistant_start|>All tests pass.<|assistant_end|><|bos|><|system_start|>tools: edit
  7. story 15.2
    make everyone happy, even when things don't go as planned.<|bos|>Once upon a time
  8. python 15.14
    <|tool_call_end|><|assistant_end|><|tool_start|>all tests passed⏎<|tool_end|><|assistant_start|>All tests pass.<|assistant_end|><|bos|>```python⏎def
  9. agent 15.13
    play with. And they all had a great time at the park.<|bos|><|system_start|>tools: edit
  10. chat 15.12
    and a good friend. And they all lived happily ever after.<|assistant_end|><|bos|><|system_start|>Answer in one
  11. story 15.12
    danced together. They were all happy and had a great time.<|assistant_end|><|bos|>Once upon a time
  12. agent 15.11
    <|tool_call_end|><|assistant_end|><|tool_start|>all tests passed⏎<|tool_end|><|assistant_start|>All tests pass.<|assistant_end|><|bos|><|system_start|>tools: edit