Skip to content
mini-lab
Features of prelude-2

Feature #2471

Fires on “ now” (not labeled yet: read the examples)

Fires on
0.25% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 41%
  • worksheet 28%
  • story 18%
  • agent 10%
  • python 3%

Makes the model say

.!." too so!"s for

Makes it not say

<|think_start|>he sureeding$oCreate

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 2.91
    . Anna gets 8 more apples. How many apples does Anna have now?<|user_end|><|assistant_start|>The
  2. chat 2.88
    . Anna gets 8 more apples. How many apples does Anna have now?<|user_end|><|assistant_start|>The
  3. chat 2.76
    . Anna gets 8 more apples. How many apples does Anna have now?<|user_end|><|assistant_start|>The
  4. chat 2.74
    . Sue gets 4 more cookies. How many cookies does Sue have now?<|user_end|><|assistant_start|>The
  5. chat 2.72
    apples. Mia gets 4 more apples. How many apples does Mia have now?<|user_end|><|assistant_start|>
  6. chat 2.71
    . Tim gets 0 more cookies. How many cookies does Tim have now?<|user_end|><|assistant_start|>The
  7. chat 2.69
    . Sam gets 0 more apples. How many apples does Sam have now?<|user_end|><|assistant_start|>The
  8. chat 2.67
    Sam gets 98 more coins. How many coins does Sam have now?<|user_end|><|assistant_start|><|think_start|>
  9. chat 2.65
    . Lucy gets 4 more balls. How many balls does Lucy have now?<|user_end|><|assistant_start|><|think_start|>
  10. chat 2.65
    . Sam gets 2 more balls. How many balls does Sam have now?<|user_end|><|assistant_start|>The
  11. chat 2.64
    . Sam gets 0 more apples. How many apples does Sam have now?<|user_end|><|assistant_start|><|tool_call_start|>
  12. chat 2.64
    Tim gets 76 more cookies. How many cookies does Tim have now?<|user_end|><|assistant_start|>The