Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #1982

Fires on “ a” (not labeled yet: read the examples)

Fires on
0.54% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 62%
  • story 15%
  • chat 9%
  • worksheet 8%
  • python 5%

Makes the model say

ands safe knew-r,u

Makes it not say

answersum sum<|think_end|> prelude Just sitonfig

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. python 2.19
    count_vowels(s
  2. story 2.08
    , and that means slowly too."⏎Sally thought about this for a moment. "I
  3. story 2.01
    of where I can find food."⏎The bird thought about this for a moment. Then he
  4. story 1.96
    always remember the fun times you have with your friends. Recording these moments
  5. story 1.94
    Bunny wanted to help Bouncy.⏎Bunny thought for a moment and then said
  6. story 1.88
    snow with the kids, but I can't." The squirrel thought for a moment and said,
  7. story 1.87
    or a picture," the voice said.⏎Tom and Anna thought for a moment. They wanted
  8. story 1.84
    my steam is not strong."⏎The wise old tree thought for a moment and said,
  9. chat 1.8
    <|system_start|>You are a helpful assistant.<|system_end|><|user_start|>Find the sum of 93 and
  10. story 1.78
    he was walking, Tim met a friendly dog. The dog wagged its tail and barked. Tim
  11. story 1.78
    it looks normal. Can you add something special?"⏎Lily thought for a moment and decided to
  12. story 1.75
    help me learn the rhythm?" The frog thought for a moment and then replied