Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #102

Fires on “ small” (not labeled yet: read the examples)

Fires on
1.57% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 74%
  • chat 17%
  • agent 6%
  • python 2%
  • worksheet 0%

Makes the model say

houseay tree treesutils rock bigA

Makes it not say

commandRenamed trained<|assistant_end|>_*. calculator plus<|think_end|>

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 6.19
    new friend.<|bos|>One day, a boy named Tim was playing near his house. He saw
  2. story 6.16
    upon a time, there was a grumpy bird. The bird lived near a big pond. Every
  3. story 5.9
    time, there was a little dog named Max. Max lived in a small house with his best
  4. story 5.84
    upon a time, there was an ugly frog. He lived in a small pond with other frog
  5. story 5.83
    time, there was a little boy named Tim. He lived in a small house with his mom
  6. story 5.74
    little dog named Spot and a little cat named Fluffy. They lived in a small house with a
  7. story 5.73
    time, there was a normal boy named Tom. He lived in a small house with his mom
  8. chat 5.72
    a time, there was a poor princess. She lived in a small house with her mom
  9. story 5.72
    time, there was a brown dog named Buddy. He lived in a small house with a big
  10. story 5.7
    his sister, Sue. They liked to play in the big park near their house. One day
  11. story 5.67
    time, there was a happy cat named Kitty. Kitty lived in a small house with her best
  12. story 5.66
    a little bird named Tim. Tim lived in a cold nest in a big tree. One day