Skip to content
mini-lab
Features of prelude-2

Feature #285

Fires on “ their” (not labeled yet: read the examples)

Fires on
1.59% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 73%
  • agent 11%
  • chat 10%
  • python 4%
  • worksheet 3%

Makes the model say

definespath promised typo`, happy happily<|arg|>

Makes it not say

There on mom see mother there Annaw

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 2.96
    from the bed to follow Mia.⏎As they went on their adventure, they came
  2. story 2.8
    thanked life for her wisdom. Together, they continued on their journey and brought life
  3. chat 2.68
    Let's keep walking, Mommy!"⏎They both smiled and went on their merry way,
  4. story 2.47
    the ground and continued their journey, knowing they
  5. story 2.4
    . They picked apples and put them in a big bag.⏎On their way back, they
  6. chat 2.31
    , and we will go together." So, Sam and Tim went on their way to the p
  7. story 2.3
    in the quiet of the day. Then, he smiled and went on his way.<|bos|><|system_start|>
  8. story 2.23
    hands and started to roll. They felt the wind and the sun on their faces. They laughed
  9. story 2.22
    unexpected thing was that Max, the big and strong dog, became their new friend, and they
  10. chat 2.2
    boat on its back. Now, they were both happy and went on many more adventures together.
  11. story 2.15
    what they built together. They knew that working together and being fair made their tower so great.
  12. story 2.14
    right way and to help each other remember to be safe. They continued their tea party, laughing