Skip to content
mini-lab
Features of prelude-2

Feature #1084

Fires on “<|bos|>” (not labeled yet: read the examples)

Fires on
0.72% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 29%
  • story 26%
  • agent 25%
  • python 10%
  • worksheet 10%

Makes the model say

Tim``` Max importI Cat Bob you

Makes it not say

b again more pultipl okay O her

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 12.53
    they had a fun day playing with the treasure in the park.<|assistant_end|><|bos|>Once upon a time
  2. chat 12.46
    played more games at the camp.<|assistant_end|><|bos|><|user_start|>Sue has
  3. chat 12.23
    went home. The loud party was a lot of fun for everyone.<|bos|><|system_start|>Start every answer
  4. agent 12.22
    on, they had many fun adventures.<|assistant_end|><|bos|><|system_start|>tools: edit
  5. chat 12.22
    Try "Run the tests" or "Rename add to plus".<|assistant_end|><|bos|><|user_start|>Anna has
  6. story 12.19
    , edit and fix the Python files in this project.<|assistant_end|><|bos|>Once upon a time
  7. chat 12.16
    Tom went home to rest after their fun day at the beach.<|assistant_end|><|bos|><|user_start|>Add 2
  8. worksheet 12.15
    Would you like a story, or some numbers to add?<|assistant_end|><|bos|>Compute 26
  9. python 12.13
    the Python files in this project.<|assistant_end|><|bos|># app.py
  10. agent 12.13
    They played with the toys and had a great time at the party.<|bos|><|system_start|>tools: edit
  11. worksheet 12.13
    and kind made their planet a fun and happy place to be.<|assistant_end|><|bos|>What's 7
  12. chat 12.12
    Would you like a story, or some numbers to add?<|assistant_end|><|bos|><|system_start|>tools: calculator