Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #687

Fires on “or” (not labeled yet: read the examples)

Fires on
0.64% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 65%
  • story 26%
  • chat 4%
  • python 3%
  • worksheet 1%

Makes the model say

<|tool_call_start|>edable`:oldStringdu> tools

Makes it not say

friends toars are many girl# everyone

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 3.13
    waved and blew a kiss to the crowd, feeling more adorable than ever.
  2. story 2.9
    girl named Lily went to play in her yard. Lily saw an adorable cat come to
  3. story 2.9
    thing at the park was the swing. She thought the swing was adorable.⏎One
  4. story 2.86
    .py`.<|assistant_end|><|bos|>Once upon a time, there was an adorable little pig named
  5. story 2.86
    warm sun, thankful for their friendship and the wise old tree's advice.<|bos|><|system_start|>
  6. story 2.86
    that it is important to listen to your mother when she gives you advice. She may
  7. story 2.85
    friendly voice answered back, "It's me! I'm a survivor from the
  8. story 2.75
    I would love to be friends with you."⏎So, the adorable mushroom
  9. story 2.75
    find adventure."⏎So the little boy listened to the stick's advice, and they
  10. story 2.74
    became angry. He shouted at John and asked him why he was recording him. John
  11. story 2.74
    story is: Always be careful and listen to the wise advice of your friends
  12. story 2.71
    happy and important. From that day on, the oven was not ignorant anymore. It