Skip to content
mini-lab
Features of prelude-2

Feature #929

Fires on “ He” (not labeled yet: read the examples)

Fires on
5.56% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 79%
  • chat 12%
  • worksheet 4%
  • agent 4%
  • python 1%

Makes the model say

wanted asked " said thought excited want couldn

Makes it not say

Thank goodbye thankYou trained again more<|bos|>

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 4.83
    In the park, Tim saw a hard twig on the ground. He picked it up and
  2. chat 4.77
    ran in the park.⏎Tom saw a small fire far away. He was scared. Max
  3. story 4.77
    Tim and Max were playing, they saw something strange in the sky. Tim looked up and rec
  4. chat 4.75
    ran in the park.⏎Tom saw a small fire far away. He was scared. Max
  5. chat 4.65
    ⏎While they were playing, they saw a mailbox near the tree. They were very curious about
  6. chat 4.63
    ran in the park.⏎Tom saw a small fire far away. He was scared
  7. story 4.59
    day they heard about an old white castle on a mountain. Harry and Emma decided to
  8. story 4.47
    ⏎As they walked, they saw a small hole in the ground. Tim said, "What
  9. story 4.35
    outside. "What's that?" asked his little friend, Tim. Max wanted to find out
  10. story 4.31
    they were playing, Tom saw a big tree with a high branch. He wanted to see if
  11. story 4.3
    lots of leaves. Tim saw a piece of stick on the ground. He picked it up and
  12. story 4.26
    sunny day, Fin saw a strange, shiny thing in the water. He swam closer and saw