Skip to content
mini-lab
Features of prelude-2

Feature #1696

Fires on “ on” (not labeled yet: read the examples)

Fires on
0.19% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 68%
  • chat 20%
  • agent 7%
  • python 3%
  • worksheet 2%

Makes the model say

an a adventures Finally playinghes Bob work

Makes it not say

medefhttpsed`:entose She

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 4.93
    a time, there was a little boy named Tim. Tim was going on a march with
  2. story 4.83
    were very happy.<|bos|>John was very excited to go on a walk. He
  3. story 4.82
    had a pet rabbit, Cotton, and they decided to go on an adventure and explore
  4. story 4.61
    ake yummy treats for her friends. One day, she decided to go on an adventure to find
  5. story 4.58
    2.<|assistant_end|><|bos|>One night, two very creative children decided to go on an adventure. The
  6. story 4.42
    661 is 6825.<|bos|>Mama was going on a trip! She
  7. story 4.04
    girl who loved to play outside. One day, she decided to go for a walk in the
  8. story 4.04
    white castle on a mountain. Harry and Emma decided to go on an adventure and find
  9. story 4.04
    <|bos|>One day, a boy named Tom and his old dog Spot went for a walk in the
  10. story 4.0
    . His name was Hank. One day, he decided to go for a walk in search
  11. story 3.99
    in this project?<|assistant_end|><|bos|>One day, a group of ants went on a march.
  12. story 3.97
    a little boy named Tim and his dog, Spot, went for a walk. They