Skip to content
mini-lab
Features of prelude-2

Feature #972

Fires on “ whole” (not labeled yet: read the examples)

Fires on
2.23% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 77%
  • chat 13%
  • agent 7%
  • python 2%
  • worksheet 0%

Makes the model say

house world town forest park count p small

Makes it not say

headkeep "python *<|arg|>ient sentence

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 9.58
    a big, tasty cake. It was the most famous cake in the whole history!
  2. story 9.35
    <|assistant_end|><|bos|>Once upon a time, there was a big event in a small town. Everyone was
  3. story 8.69
    beautiful rainbow in the sky.⏎Lily
  4. story 8.44
    <|assistant_end|><|bos|>Once upon a time, there was a big party in a small town. All the
  5. story 8.4
    day. The sunflower became the biggest and tallest one in the whole town.⏎One
  6. story 8.39
    495<|assistant_end|><|bos|>Once upon a time, in a small house near the big
  7. story 8.38
    rest of the nice day.<|bos|>Once upon a time, in a small town, there lived
  8. story 8.33
    big red shirt and say, "I am the strongest boy in the world!"⏎One
  9. story 8.28
    and steam filled the room. Mum
  10. story 8.26
    all the animals in the forest.⏎One
  11. story 8.21
    she could. She became the bravest kitty in the whole park.⏎The
  12. story 8.19
    . Every day, he was the bravest animal in the whole jungle. All the