Skip to content
mini-lab
Features of prelude-2

Feature #2934

Fires on “ ” (not labeled yet: read the examples)

Fires on
0.47% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 36%
  • chat 29%
  • agent 29%
  • story 5%
  • python 2%

Makes the model say

+python language preludeuallyhello * you

Makes it not say

, whole<|bos|> Lily bag any face ask

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 2.56
    you tell me what 6 + 2
  2. chat 2.31
    Could you tell me what 29 +
  3. chat 2.09
    use the calculator.<|system_end|><|user_start|>Could you tell me what 33 + 41 is
  4. worksheet 2.05
    91.⏎Could you tell me what 8754 + 2 is
  5. worksheet 2.02
    1791⏎Could you tell me what 44501 + 2
  6. chat 1.99
    lemon⏎house!⏎```<|assistant_end|><|bos|><|user_start|>Could you tell me what 960 +
  7. chat 1.96
    and went home to get warm.<|bos|><|user_start|>Could you tell me what 43 +
  8. worksheet 1.96
    683.⏎Could you tell me what 533 + 89
  9. chat 1.94
    The answer is 21.<|assistant_end|><|user_start|>Could you tell me what 1 + 0
  10. worksheet 1.94
    = 33.⏎Could you tell me what 92177 +
  11. worksheet 1.92
    add numbers.<|assistant_end|><|bos|>Could you tell me what 92242 + 4
  12. worksheet 1.91
    666.⏎Could you tell me what 2890 + 24