Skip to content
mini-lab
Features of prelude-2

Feature #3461

Fires on “ day” (not labeled yet: read the examples)

Fires on
1.12% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 64%
  • chat 15%
  • worksheet 10%
  • python 7%
  • agent 4%

Makes the model say

sky with they end day8.um

Makes it not say

asschema or⏎ os calculator every+

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 5.04
    cars go by as Tim ate his ice cream. It was a fun day.<|bos|># words
  2. story 4.96
    thanked his mom and dad for the special treat. It was the best day ever!<|bos|><|user_start|>
  3. story 4.87
    door. Both of them were happy and laughing. What a great day!<|bos|>If you
  4. story 4.85
    looking for new fun things to do together. And they never forgot the day they found the big
  5. chat 4.84
    , and they laughed. The sun was shining. It was a fun day. Tom still thought
  6. story 4.67
    , driving and laughing the whole day.⏎It was the best day ever.<|bos|>Once
  7. story 4.56
    to go home. They left the maze, excited for the next fun day at the park.
  8. story 4.55
    aundry together and enjoyed the rest of the nice day.<|bos|>Once upon
  9. story 4.52
    good! They laughed and shared the good apple. It was a fun day at the park for
  10. story 4.51
    It was a calm day, and Mia was
  11. story 4.45
    -up for doing something nice for the dog. It was the best day ever!<|bos|><|system_start|>
  12. story 4.4
    the mess, but first, they took a funny picture to remember the day. In the end