Skip to content
mini-lab
Features of prelude-2

Feature #259

Fires on “Find” (not labeled yet: read the examples)

Fires on
0.72% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 33%
  • story 25%
  • chat 21%
  • worksheet 13%
  • python 9%

Makes the model say

the their how away her([run[::-

Makes it not say

acche `welcomeLook⏎ree absolute

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 4.45
    Find the sum of
  2. worksheet 4.34
    416 is 416.⏎Find the sum of
  3. chat 4.24
    <|system_start|>You are mini, a small and friendly assistant.<|system_end|><|user_start|>Find the sum of
  4. chat 3.95
    good friends. And the ant never complained again.<|bos|><|user_start|>Find the sum of
  5. chat 3.88
    them to do.<|bos|><|system_start|>You are a helpful assistant.<|system_end|><|user_start|>Find the sum of
  6. worksheet 3.82
    and add numbers, step by step or with a calculator.<|assistant_end|><|bos|>Find the sum of
  7. chat 3.81
    <|system_start|>You are a helpful assistant.<|system_end|><|user_start|>Find the sum of
  8. worksheet 3.79
    70 + 44 = 3414.⏎Find the sum of
  9. worksheet 3.77
    178 + 5 = 2183.⏎Find the sum of
  10. chat 3.77
    <|bos|><|system_start|>You are mini, a small and friendly assistant.<|system_end|><|user_start|>Find the sum of
  11. worksheet 3.76
    plus 9153 is 9199.⏎Find the sum of
  12. worksheet 3.75
    more. Now Lucy has 33333 toys.<|bos|>Find the sum of