Skip to content
mini-lab
Features of prelude-2

Feature #1553

Fires on “ was” (not labeled yet: read the examples)

Fires on
1.47% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 68%
  • agent 15%
  • chat 13%
  • worksheet 2%
  • python 2%

Makes the model say

playing very outside at to out idea in

Makes it not say

end branches adder are multipl smiledred

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 4.91
    8745.<|bos|>One day, a little boy named Timmy was curious about what was
  2. story 4.82
    , 3)⏎1⏎<|bos|>One day, a little monkey was playing in the trees
  3. story 4.79
    step or with a calculator.<|assistant_end|><|bos|>One day, a sweet cat was walking in the park
  4. story 4.7
    toy weapon.<|bos|>One day, a cat named Bow was walking in the yard
  5. story 4.7
    " " + b⏎```⏎<|bos|>One day, a little ant was walking in the park
  6. story 4.68
    `app.py`.<|assistant_end|><|bos|>One day, a little red bird was flying in the sky
  7. story 4.68
    638.<|assistant_end|><|bos|>One day, a boy named Tom was very eager to dis
  8. chat 4.62
    One day, Ben was playing with his best
  9. story 4.57
    10236.<|bos|>One day, a girl named Lily was playing in her room
  10. story 4.57
    ⏎5.5⏎<|bos|>One day, a little dog named Max was very bored. He
  11. story 4.56
    is 8.<|assistant_end|><|bos|>One day, a little girl named Lily was playing with her toy
  12. story 4.55
    : `run.py`.<|assistant_end|><|bos|>One day, a small bird was flying in the sky