Skip to content
mini-lab
Features of prelude-2

Feature #1595

Fires on “ were” (not labeled yet: read the examples)

Fires on
0.26% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 25%
  • story 22%
  • worksheet 18%
  • chat 18%
  • python 17%

Makes the model say

both many twoumpreturn donereplaceAll all

Makes it not say

addsdivides had "!"Once: it was

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 3.87
    `.⏎<|bos|>Once upon a time, in a beautiful land, there were many colors. The
  2. story 3.76
    .<|assistant_end|><|bos|>Once upon a time there were two children, Joe
  3. story 3.73
    a time, there was a colorful farm. On this farm, there were many animals. The
  4. story 3.67
    time, there was a mighty big farm. On this farm, there were many animals who liked
  5. story 3.59
    a time, there was a small pond. In the pond, there were many fish. A
  6. story 3.55
    was a big red barn on a farm. In the barn, there were many animals. One
  7. story 3.45
    big university. In this university, there were many kids who liked
  8. story 3.42
    , he could do anything he wanted!<|bos|>Once upon a time there were two best friends,
  9. story 3.42
    upon a time there were two shapes. One
  10. story 3.39
    the snow all day.<|bos|>Once upon a time, there were two friends called A
  11. story 3.33
    , there was a big hall. In the hall, there were many toys. Some
  12. story 3.3
    <|think_end|>The answer is 6.<|assistant_end|><|bos|>Once upon a time there were two friends, a