Skip to content
mini-lab
Features of prelude-2

Feature #1200

Fires on “ have” (not labeled yet: read the examples)

Fires on
1.21% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 47%
  • chat 19%
  • python 17%
  • agent 10%
  • worksheet 7%

Makes the model say

to for. toys or, One."

Makes it not say

oldString<|assistant_end|>replaceAll definesRename`: edit*

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 4.02
    ⏎"Okay, we can share the shell, Ben. But you have to help me build
  2. story 3.73
    toys," she said. "You can play with these. But you have to share and be
  3. story 3.52
    for my friends?"⏎Her mom said, "Yes, but you have to be quiet.
  4. story 3.46
    "I know, girls," their mom said. "But you have to be careful with
  5. story 3.45
    fun. They tell their moms. Their moms say yes, but they have to be back by
  6. story 3.39
    some. Her mom said, "We can pick some, but we have to be quick.
  7. story 3.25
    , "OK, Tom, you can play with us. But you have to be nice and
  8. story 3.22
    fun."⏎"OK, Tom!" Lily said. "But we have to be careful.
  9. story 3.19
    said, "I know, Sara. I know. But sometimes we have to do hard things
  10. story 3.13
    will be fun!"⏎"OK!" Ann says. "But we have to be careful.
  11. story 3.1
    said, "Of course I will help you, Lily. But you have to help too.
  12. story 3.09
    him. They say, "We love you, Tom. But you have to listen and be