Skip to content
mini-lab
Features of prelude-2

Feature #1959

Fires on “ very” (not labeled yet: read the examples)

Fires on
1.30% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 88%
  • chat 9%
  • agent 1%
  • python 1%
  • worksheet 1%

Makes the model say

too very lot even he One so idea

Makes it not say

typo[- ontokemember<|think_start|><|arg|>er

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 6.64
    . She loved it and refused to
  2. story 6.06
    liked the animals, but they
  3. story 6.01
    loved cartoons. Her
  4. story 5.99
    Lily loved her pink bed very much.⏎
  5. chat 5.77
    ⏎All the kids came to look at the cake. They liked the cake a lot. They
  6. story 5.76
    are pretty and colorful. She likes them.⏎"Can
  7. story 5.75
    toys every day. He had a toy axe that he loved very much. He would
  8. story 5.64
    .⏎Sara thought for a moment. She liked the shell, but she liked
  9. story 5.56
    ed little girl named Amy. Amy had a pink dress that she loved very much. One day
  10. story 5.52
    little boy named Tim. He had a black toy car that he loved very much. One day
  11. story 5.52
    . He hopes they will play with him later. He likes the blocks. He thinks they
  12. story 5.51
    a calm day, and Mia was very happy. She loved her new pillow. She played with