Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #3385

Fires on “ me” (not labeled yet: read the examples)

Fires on
0.38% of tokens
Mostly in
python
Layer
after block 4

Where it fires

  • python 48%
  • chat 31%
  • worksheet 8%
  • agent 8%
  • story 4%

Makes the model say

==:`.alculator gets getantutastic

Makes it not say

Hello. itemHiselves together noticedhe

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 3.27
    ⏎<|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>Could you tell me what 89
  2. chat 3.24
    ⏎lemon⏎house!⏎```<|assistant_end|><|bos|><|user_start|>Could you tell me what 96
  3. chat 3.23
    their friends. And they all lived happily ever after.<|bos|><|user_start|>Tell me a story.<|user_end|>
  4. chat 3.22
    new friend and went home to get warm.<|bos|><|user_start|>Could you tell me what 43
  5. chat 3.18
    went home with big smiles on their faces.<|bos|><|user_start|>Could you tell me what 8 +
  6. chat 3.13
    + 815 = 819.<|bos|><|user_start|>Tell me about the hist
  7. chat 3.11
    .<|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>Could you tell me what 12
  8. chat 3.09
    to do something to help somebody in need.<|bos|><|user_start|>Tell me a story about a
  9. chat 3.08
    numbers, step by step or with a calculator.<|assistant_end|><|bos|><|user_start|>Tell me a story.<|user_end|>
  10. worksheet 3.07
    28 equals 17107.⏎Could you tell me what 59
  11. chat 3.05
    place, Lucy was happy to go home and rest.<|bos|><|user_start|>Tell me a story.<|user_end|>
  12. chat 3.05
    4544 = 4550<|bos|><|user_start|>Tell me about yourself.<|user_end|>