Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #165

Fires on “ation” (not labeled yet: read the examples)

Fires on
2.08% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 77%
  • agent 10%
  • chat 9%
  • worksheet 2%
  • python 2%

Makes the model say

s and's, becausehing. on

Makes it not say

Thank trained⏎⏎ = sum:<|assistant_end|><|arg|>

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 2.87
    party. It was a very special party. The party had colorful decorations, yummy food
  2. story 2.72
    they did not believe the spoon could go to the
  3. story 2.64
    took their three-year-old to the store to buy decorations. They rolled
  4. story 2.57
    fill them with water. They pretended they were making ponds for the frogs and fish.
  5. story 2.57
    . They did not like the cat. The cat was
  6. story 2.47
    walking in the woods. It was very quiet and he could hear the wind blowing through the
  7. story 2.4
    the grass. They held hands and started to roll. They felt the wind and the sun on
  8. story 2.37
    with her friends. So, she decided to supply all the cups, plates
  9. chat 2.3
    .⏎By the end of the day, everyone forgot about the kitten. But later that
  10. story 2.3
    He wanted to play with the hook, but he needed
  11. story 2.26
    get me a pear?" The little girl was scared of the lion's roar.
  12. story 2.25
    to mail the letter. She put the