Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #400

Fires on “ to” (not labeled yet: read the examples)

Fires on
0.31% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 34%
  • agent 29%
  • story 14%
  • python 14%
  • worksheet 8%

Makes the model say

pattern calculator<|user_end|> pickedemo listutils know

Makes it not say

? it the_ sorryh by don

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 3.87
    You are mini, a small and friendly assistant.<|system_end|><|user_start|>I need to know 0 +
  2. chat 3.85
    887 = 1507.<|bos|><|user_start|>I need to know 89
  3. chat 3.85
    9<|think_end|>The answer is 69.<|assistant_end|><|bos|><|user_start|>I need to know 55
  4. chat 3.82
    toy.<|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>I need to know 50
  5. chat 3.82
    8<|think_end|>The answer is 78.<|assistant_end|><|bos|><|user_start|>I need to know 38
  6. chat 3.81
    08 = 13142.<|bos|><|user_start|>I need to know 5 +
  7. chat 3.81
    and 79 is 151.<|bos|><|user_start|>I need to know 21
  8. chat 3.79
    79 equals 54218.<|bos|><|user_start|>I need to know 73
  9. chat 3.77
    <|think_end|>The answer is 189.<|assistant_end|><|bos|><|user_start|>I need to know 8 +
  10. chat 3.77
    very yummy, and they had a fun day.<|bos|><|user_start|>I need to know 41
  11. chat 3.76
    4<|think_end|>The answer is 94.<|assistant_end|><|bos|><|user_start|>I need to know 55
  12. worksheet 3.73
    sum of 6 and 0 is 6.⏎I need to know 98