Skip to content
mini-lab
Features of prelude-2

Feature #344

Fires on “ another” (not labeled yet: read the examples)

Fires on
0.49% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 54%
  • chat 22%
  • agent 16%
  • python 7%
  • worksheet 1%

Makes the model say

years lower. first min storyute too

Makes it not say

python had for behind triangle edit has give

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 5.85
    Goodbye!<|user_end|><|assistant_start|>Sure! Bye! Come back for another story soon.<|assistant_end|>
  2. chat 5.66
    for a story!<|assistant_end|><|user_start|>
  3. chat 5.47
    ee you later!<|user_end|><|assistant_start|>Sure! Bye! Come back for another story soon.<|assistant_end|>
  4. story 5.46
    a very ancient flag waved in the wind. It had been there for a long, long time
  5. chat 5.44
    for another story soon.<|assistant_end|>
  6. chat 5.44
    for another story soon.<|assistant_end|>
  7. chat 5.37
    8.<|assistant_end|><|user_start|>Good night!<|user_end|><|assistant_start|>Bye! Come back for another story soon.<|assistant_end|>
  8. chat 5.36
    <|system_end|><|user_start|>See you later!<|user_end|><|assistant_start|>Bye! Come back for another story soon.<|assistant_end|>
  9. chat 5.32
    add?<|assistant_end|><|user_start|>Goodbye!<|user_end|><|assistant_start|>Bye! Come back for another story soon.<|assistant_end|>
  10. chat 5.28
    for me?<|user_end|><|assistant_start|>
  11. python 5.28
    for n in nums]
  12. story 5.28
    for what he had done