Skip to content
mini-lab
Features of prelude-2

Feature #4005

Fires on “ tell” (not labeled yet: read the examples)

Fires on
0.31% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 58%
  • story 22%
  • agent 13%
  • worksheet 5%
  • python 3%

Makes the model say

a your help me my welcome his(

Makes it not say

ell Falseasananaklsptvowels

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 4.71
    't like to play with the other boats.<|assistant_end|><|user_start|>Can you tell me a story?
  2. chat 4.61
    <|user_start|>Can you tell me a story about
  3. chat 4.55
    .<|assistant_end|><|bos|><|system_start|>You are a helpful assistant.<|system_end|><|user_start|>Can you tell me a story?
  4. chat 4.51
    <|user_end|><|assistant_start|>The answer is 815.<|assistant_end|><|user_start|>Can you tell me a story about
  5. chat 4.49
    only know how to tell stories and add numbers.<|assistant_end|><|user_start|>Can you tell me a story?
  6. chat 4.44
    tests pass now.<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>Can you tell me a story about
  7. chat 4.38
    .<|assistant_end|><|bos|><|system_start|>Answer in one short sentence.<|system_end|><|user_start|>Can you tell me a story?
  8. chat 4.35
    they played together happily.<|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>Can you tell me a story?
  9. chat 4.22
    toys.<|bos|><|system_start|>Answer in one short sentence.<|system_end|><|user_start|>Can you tell me a story about
  10. chat 4.22
    .py` with `initial(s)`.<|assistant_end|><|bos|><|user_start|>Can you tell me a story about
  11. chat 4.22
    : calculator<|system_end|><|system_start|>You are a helpful assistant.<|system_end|><|user_start|>Can you tell me a story about
  12. chat 4.2
    0<|think_end|>The answer is 10.<|assistant_end|><|bos|><|user_start|>Can you tell me a story?