Skip to content
mini-lab
Features of prelude-2

Feature #2494

Fires on “ and” (not labeled yet: read the examples)

Fires on
0.45% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 71%
  • chat 12%
  • python 10%
  • agent 6%
  • worksheet 2%

Makes the model say

plus did heOne it went the then

Makes it not say

)` import **oldt<|assistant_end|>))<|tool_call_end|>

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 2.51
    not like me. What can we do?" Sue thought for a moment and said, "I
  2. story 2.49
    to help Bouncy.⏎Bunny thought for a moment and then said, "
  3. story 2.48
    Sue, so they looked for the toy bear together.⏎They looked and looked, but they
  4. story 2.46
    be the best swimmer in the sea." Fin thought for a moment and said, "Let
  5. story 2.46
    I cannot find a place to rest." The girl thought for a moment and said, "I
  6. story 2.43
    they both started to look for the pants.⏎They looked and looked, but they
  7. story 2.39
    hole. What do you think is inside?" Sue thought for a moment and said, "Maybe
  8. story 2.37
    go on a quest to find something to make it better. He searched and searched, but nothing
  9. story 2.35
    her and wanted to help his friend.⏎Puppy thought hard and had an idea.
  10. story 2.34
    Emma was determined to find it's nest. She searched and searched until she finally
  11. story 2.32
    give the coin if you want the candy."⏎Tim thought about it and decided he wanted the
  12. story 2.26
    f for your hat," Zip said. The bird thought about it and said, "Okay