Skip to content
mini-lab
Features of prelude-2

Feature #998

Fires on “ big” (not labeled yet: read the examples)

Fires on
0.47% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 56%
  • chat 25%
  • agent 15%
  • worksheet 3%
  • python 2%

Makes the model say

blue red tree kn enden letT

Makes it not say

< revernextschema mark]`mean()`.

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 2.87
    are sorry, big bird. We will leave your eggs here." The big bird was happy,
  2. chat 2.75
    ⏎Max saw a big cat and wanted to play with it. The big cat did not want
  3. story 2.75
    ran away, but Chicky was too scared to move. The big dog came closer and
  4. story 2.72
    5<|assistant_end|><|bos|>Once upon a time, in a small house near the big tree, a little
  5. story 2.68
    So, Bobo and Kiki did yoga together under the big tree. They had
  6. story 2.59
    no more tea to drink and their house was not tidy anymore. The big, mean monster had
  7. story 2.58
    the ball, laughing and having fun. He played all day under the big rainbow.<|bos|><|system_start|>
  8. story 2.54
    The red bird and the big blue bird sat in
  9. story 2.53
    thought of a plan.⏎Max wagged his tail very fast. The big, scary bird saw
  10. story 2.53
    song to make Tim feel brave.⏎When Tim got down, the big dog was gone.
  11. story 2.52
    to roll down the hill. The small circle went very fast. The big circle was surprised!
  12. story 2.51
    back to their warm, cozy house and promised to never play near the big train again.⏎