Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #1725

Fires on “ and” (not labeled yet: read the examples)

Fires on
0.27% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 64%
  • agent 15%
  • chat 13%
  • python 7%
  • worksheet 1%

Makes the model say

a named her his with an dog many

Makes it not say

oldStringmdalculatorIfased<|system_start|>Fixed_*.

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 5.95
    played together at the park every day.<|bos|>One day, a cat and a dog were playing
  2. chat 5.92
    a story about a cat!<|user_end|><|assistant_start|>One day, a big cat and a little dog were
  3. story 5.77
    helpers.py⏎all tests passed⏎<|bos|>One day, a cat and a dog went to
  4. story 5.69
    .py⏎all tests passed⏎<|bos|>One day, a big cat and a small dog were
  5. story 5.69
    get 44766.<|bos|>One day, a cat and a dog had a
  6. chat 5.52
    <|user_start|>Write a story for me.<|user_end|><|assistant_start|>One day, a cat and a dog were walking
  7. story 5.47
    46720.<|bos|>One day, a big cat and a small dog were
  8. story 5.47
    what a zipper is.<|bos|>One day, a big dog and a little cat went
  9. story 5.42
    .<|assistant_end|><|bos|>Once upon a time there were two friends, a rabbit and a dog. The
  10. story 5.33
    Try asking me for a story!<|assistant_end|><|bos|>One day, a cat and a dog were playing
  11. story 5.3
    ed correctly.<|bos|>One day, a big cat and a small dog were
  12. story 5.16
    helping others can make you happy too.<|bos|>One day, a cat and a dog were playing