Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #1053

Fires on “ what” (not labeled yet: read the examples)

Fires on
0.68% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 28%
  • worksheet 24%
  • python 21%
  • story 18%
  • agent 9%

Makes the model say

to!NowBob wayowedgest where

Makes it not say

x One He`Sorry most o be

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 2.12
    +7=10, 109<|think_end|>Sure! The answer is
  2. chat 2.0
    <|bos|><|system_start|>Start every answer with "Sure!".<|system_end|><|user_start|>Hi<|user_end|><|assistant_start|>Sure! Hi there
  3. worksheet 1.99
    0 = 9262.⏎Could you tell me what 99 +
  4. worksheet 1.96
    72 is 165.⏎Could you tell me what 74 +
  5. worksheet 1.96
    + 6 = 683.⏎Could you tell me what 533
  6. chat 1.95
    <|system_start|>Start every answer with "Sure!".<|system_end|><|user_start|>Hi!<|user_end|><|assistant_start|>Sure! Hi there
  7. chat 1.94
    Goodbye!<|user_end|><|assistant_start|>Sure! Bye!
  8. chat 1.92
    Sure!".<|system_end|><|user_start|>I want a story about the sea!<|user_end|><|assistant_start|>Sure! Once upon
  9. worksheet 1.91
    + 25 = 91.⏎Could you tell me what 875
  10. worksheet 1.89
    Now Tim has 326 stars.⏎Could you tell me what 5 +
  11. worksheet 1.89
    7 plus 5 equals 12.⏎Could you tell me what 609
  12. worksheet 1.89
    6 = 83457.⏎Could you tell me what 40 +