Skip to content
mini-lab
Features of prelude-2

Feature #813

Fires on “ their” (not labeled yet: read the examples)

Fires on
0.13% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 56%
  • story 32%
  • chat 7%
  • worksheet 2%
  • python 2%

Makes the model say

" hadEvery0 enjoy h takingore

Makes it not say

function Suddenly brother!") watch<|think_end|>SE up

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 2.12
    decided to share the fruit with all their jungle friends. Max
  2. story 2.01
    and Willy were very happy, and they shared the treasure with all their friends in the sea
  3. story 1.73
    was so proud of his knowledge. He shared it with all his friends, and he
  4. story 1.67
    he picked the oranges. They shared the oranges with their friends.⏎The
  5. story 1.66
    all day. They were very happy and shared their new treasure with all their friends.<|bos|>Once
  6. story 1.6
    Lily showed her picture to her mom. "Look
  7. story 1.55
    keep it unfolded and shared the wisdom with both of them. They
  8. story 1.45
    can come back and play with me. But he has to ask first before he eats our
  9. story 1.45
    . There was no film inside! Instead, there were yummy treats for all of them. They
  10. story 1.44
    and shared them with their friends. And they
  11. story 1.44
    Everyone in the town loved the festival. It was a special time for all the people.⏎
  12. story 1.41
    river? It is here to protect you, if you don't watch out, the chain