Skip to content
mini-lab
Features of prelude-2

Feature #3871

Fires on “ who” (not labeled yet: read the examples)

Fires on
7.73% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 69%
  • chat 21%
  • agent 5%
  • python 4%
  • worksheet 2%

Makes the model say

liked every lived loved many wanted always people

Makes it not say

trainedoldString surprise againexpressionnew<|assistant_end|> realized

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 7.81
    , there was a little dog named Spot. Spot was a dependable dog who loved to play outside
  2. story 7.32
    , there lived a cute dog named Max. Max was a hero dog who loved to help people
  3. story 7.03
    , there was a little girl named Lucy. Lucy was a dependable girl who always kept her prom
  4. story 6.85
    , there was a dependable dog named Spot. Spot was a good dog who loved to play and
  5. story 6.74
    ebra named Zara. Zara was an independent zebra who loved to play hide
  6. story 6.69
    , there was a little boy named Tim. Tim was a normal boy who liked to play with
  7. story 6.6
    <|bos|>Once upon a time, there was a big, noisy dragon. He lived in a dark
  8. story 6.51
    9.<|assistant_end|><|bos|>Once upon a time, there was a big animal who was a parent.
  9. story 6.5
    , there was a giant. The giant was very big and strong. He had a sharp stick
  10. story 6.45
    was a dove named Dee. Dee was a weird dove. She liked to nap all
  11. chat 6.45
    there was a little ant named Andy. Andy was a dependable ant. He always did his best
  12. story 6.43
    was a mighty cat named Tom. Tom was very big and strong. He lived in a wide