Skip to content
mini-lab
Features of prelude-2

Feature #1196

Fires on “ of” (not labeled yet: read the examples)

Fires on
0.21% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 67%
  • agent 23%
  • chat 7%
  • python 3%
  • worksheet 1%

Makes the model say

ver$ branch runhe anumber subtract

Makes it not say

⏎⏎ functionWow park years anymore()⏎

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 2.37
    happy. He had an idea! He went to the little boy and offered him a
  2. story 2.3
    . The man said he had a big bag of sour candy. He offered Tom some
  3. story 2.15
    . Do you want to help me?" Mom asked. She smiled and offered them the
  4. story 1.99
    , Dad, a brother and a sister enjoyed living in it. They often discus
  5. chat 1.97
    let you play with the boat
  6. story 1.94
    92.<|bos|>Once there was a little girl named Lucy. She often wanted to dress
  7. story 1.89
    would rush out from behind the curtain and shout, "Here I am!" They both
  8. story 1.88
    until they couldn't laugh anymore.⏎From that day on, they often joked and
  9. story 1.88
    little girl named Ann. She was a very happy child, but she often complained
  10. story 1.82
    Mom?" Lily and Ben asked.⏎Mom nodded. "Yes, of course. You can
  11. story 1.75
    , he stopped and spoke out loud: "Look what I have discovered! A cool
  12. story 1.72
    25.<|bos|>Alice was a gifted little girl. She often stared int