Skip to content
mini-lab
Features of prelude-2

Feature #1685

Fires on “ is” (not labeled yet: read the examples)

Fires on
0.57% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 41%
  • agent 33%
  • story 11%
  • worksheet 10%
  • python 5%

Makes the model say

sizeret funs floor animals watch

Makes it not say

cheThisestFromnumberEx warjson

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 3.89
    <|user_start|>Thank you<|user_end|><|assistant_start|>Sure! You're welcome!<|assistant_end|><|bos|>What is the sum of
  2. worksheet 3.54
    `return x * x`. The tests pass now.<|assistant_end|><|bos|>What is the sum of
  3. chat 3.44
    their friendship grew stronger.<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>What is 32 plus
  4. chat 3.43
    ever after.<|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>What is 88 plus
  5. chat 3.42
    was not hungry anymore.<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>What is 694
  6. chat 3.42
    5.<|assistant_end|><|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>What is the sum of
  7. chat 3.42
    enjoying the beautiful Sunday morning together.<|assistant_end|><|bos|><|user_start|>What is the sum of
  8. chat 3.42
    now.<|assistant_end|><|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>What is 3 plus
  9. chat 3.41
    learning.<|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>What is 6 +
  10. chat 3.39
    tools: calculator<|system_end|><|system_start|>You are a helpful assistant.<|system_end|><|user_start|>What is 970
  11. worksheet 3.39
    <|tool_start|>all tests passed⏎<|tool_end|><|assistant_start|>All tests pass.<|assistant_end|><|bos|>What is 480
  12. chat 3.37
    (a, b)`.<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>What is the tallest mountain