Skip to content
mini-lab
Features of prelude-2

Feature #578

Fires on “ were” (not labeled yet: read the examples)

Fires on
0.53% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 56%
  • agent 34%
  • chat 7%
  • python 2%
  • worksheet 0%

Makes the model say

lot toys many room toy loved shiny table

Makes it not say

<|assistant_end|> ==ningAddedpythonCreate create The

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 5.33
    the top. Finally, the box opened. Inside the box, there were many colorful balls.
  2. story 4.83
    She pushed the door and it opened easy. Inside the tower, there were many stairs.
  3. story 4.75
    went closer to the box and looked inside. Inside the box, there were many colorful balls.
  4. story 4.58
    's home, the girl opened the box. Inside the box, there were many mild birds
  5. story 4.44
    box under the tree. She opened it and saw treasure inside. There were pretty stones and
  6. story 4.4
    the chest opened and they saw lots of pretty things inside. There were toys, balls,
  7. story 4.15
    The cat came back with a big bag. Inside the bag, there were many toys for the
  8. chat 4.15
    very curious. He opened the box and found a treasure inside! There were shiny coins and pretty
  9. story 4.13
    a big drawer in her room. Inside the drawer, there were many toys. Lily
  10. story 4.12
    and Tom were so happy. But, when they looked inside, there were no muffins
  11. story 4.12
    kitchen, there was a drawer. Inside the drawer, there were many friends. There
  12. story 4.11
    , there was a big garage. Inside the garage, there were many things to play