Skip to content
mini-lab
Features of prelude-2

Feature #2108

Fires on “0” (not labeled yet: read the examples)

Fires on
2.86% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 46%
  • chat 44%
  • agent 7%
  • python 3%
  • story 1%

Makes the model say

+ly foundar dress first main were

Makes it not say

ThanknewString=**/*.Setpath surpriseread more

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 6.6
    <|user_start|>What is 54 plus 5?<|user_end|><|assistant_start|><|think_start|>54+05:
  2. chat 6.28
    <|user_start|>What is 99 + 4?<|user_end|><|assistant_start|><|think_start|>99+04:
  3. chat 6.22
    .<|system_end|><|user_start|>what is 98+1<|user_end|><|assistant_start|><|think_start|>98+01:
  4. chat 6.2
    me what 89 + 3 is?<|user_end|><|assistant_start|><|think_start|>89+03:
  5. chat 6.19
    <|user_start|>What is 20 + 7?<|user_end|><|assistant_start|><|think_start|>20+07:
  6. chat 6.11
    add 65 and 8 for me?<|user_end|><|assistant_start|><|think_start|>65+08:
  7. chat 6.1
    much is 20 + 47?<|user_end|><|assistant_start|><|think_start|>20+47:
  8. chat 6.07
    sum of 90 and 86.<|user_end|><|assistant_start|><|think_start|>90+86:
  9. chat 6.04
    add 65 and 8 for me?<|user_end|><|assistant_start|><|think_start|>65+08:
  10. chat 5.99
    <|system_end|><|user_start|>what is 57+21<|user_end|><|assistant_start|><|think_start|>57+21:
  11. chat 5.94
    What is 44 plus 41?<|user_end|><|assistant_start|><|think_start|>44+41:
  12. chat 5.89
    What's 66 + 31?<|user_end|><|assistant_start|><|think_start|>66+31: