Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #2344

Fires on “ the” (not labeled yet: read the examples)

Fires on
0.69% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 27%
  • python 25%
  • agent 25%
  • chat 18%
  • story 6%

Makes the model say

result range even intoal matterjson

Makes it not say

<|tool_call_end|>s turns language They]<|assistant_end|> His

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 4.21
    add numbers, step by step or with a calculator.<|assistant_end|><|bos|>Find the sum of 6
  2. chat 4.18
    <|system_start|>You are mini, a small and friendly assistant.<|system_end|><|user_start|>Find the sum of 2
  3. chat 4.17
    tools: calculator<|system_end|><|system_start|>You are a helpful assistant.<|system_end|><|user_start|>Find the sum of 9
  4. chat 4.1
    and they were now friends.<|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>Find the sum of 6
  5. chat 4.09
    <|system_start|>You are a helpful assistant.<|system_end|><|user_start|>Find the sum of 9
  6. chat 4.04
    to do.<|bos|><|system_start|>You are a helpful assistant.<|system_end|><|user_start|>Find the sum of 0
  7. chat 4.02
    <|system_start|>You are mini, a small and friendly assistant.<|system_end|><|user_start|>Find the sum of 7
  8. chat 3.99
    now.<|assistant_end|><|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>Find the sum of 8
  9. chat 3.96
    : all tests passed.<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>Find the sum of 2
  10. chat 3.92
    vice.<|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>Find the sum of 1
  11. worksheet 3.91
    , edit and fix the Python files in this project.<|assistant_end|><|bos|>Find the sum of 4
  12. chat 3.89
    change.<|bos|><|system_start|>Start every answer with "Sure!".<|system_end|><|user_start|>Find the sum of 1