Skip to content
mini-lab
Features of prelude-2

Feature #3681

Fires on “ a” (not labeled yet: read the examples)

Fires on
0.63% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 70%
  • chat 22%
  • agent 6%
  • worksheet 1%
  • python 1%

Makes the model say

noise animalsl sun kids red started bear

Makes it not say

fliphttps. upon list>>> or favorite

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 2.83
    Once upon a time, in a small town, there was a team of kids who liked to
  2. story 2.76
    was mild. The pole was in the middle of a park where kids liked to play
  3. story 2.69
    teacher who was very nice. The classroom was a regular place where kids could be happy
  4. story 2.68
    <|bos|>One day, a little ball named B
  5. story 2.63
    this project.<|assistant_end|><|bos|>Once upon a time, there was a gifted little girl named Amy
  6. story 2.63
    answer is 537.<|assistant_end|><|bos|>One day, a lively girl named Mia found
  7. story 2.6
    , there was a loud party in a big house. Lots of kids came to play
  8. story 2.58
    a story, or some numbers to add?<|assistant_end|><|bos|>One day, a strong boy named Tom
  9. story 2.56
    Lucy for making it look so pretty.<|bos|>One day, a little cat named
  10. story 2.56
    should we do in this project?<|assistant_end|><|bos|>One day, a group of ants went on a
  11. chat 2.54
    to go to a new place. He wanted to find a port where he could rest.
  12. story 2.54
    , 968<|think_end|>968<|assistant_end|><|bos|>One day, a little plane was flying