Skip to content
mini-lab
Features of prelude-2

Feature #1262

Fires on “ give” (not labeled yet: read the examples)

Fires on
0.50% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 36%
  • agent 31%
  • python 25%
  • chat 6%
  • worksheet 2%

Makes the model say

upe back us madai ne

Makes it not say

= while wore +⏎ where<|assistant_end|>ites

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 7.93
    and tried again, but he fell once more. He did not give up, and he
  2. story 7.65
    er and harder. Max was very tired, but he did not give up. Finally,
  3. story 7.05
    but it did not open. They were sad, but they did not give up. They decided
  4. story 6.79
    the ground.⏎Sue and Tom were sad, but they did not give up. They went
  5. story 6.78
    , but the laces would not stay together. But Tim did not give up. He used
  6. story 6.66
    still too heavy, and it did not move.⏎Tim did not give up. He asked
  7. story 6.44
    chest. It was very hard to open, but they did not give up.⏎Finally
  8. story 6.23
    , but not the bear's body. She felt sad but did not give up.⏎Amy
  9. story 6.22
    story is to always ask for help when you need it, and never give up.<|bos|>Bug
  10. story 6.16
    his yoga mat away. Tom was sad, but he did not give up. He tried
  11. story 6.0
    big bubble. Ducky felt sad, but he did not give up. He knew
  12. story 5.84
    He waited for the turtle. The turtle kept walking slow and did not give up.⏎When