Skip to content
mini-lab
Features of prelude-2

Feature #3527

Fires on “ "” (not labeled yet: read the examples)

Fires on
1.11% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 56%
  • worksheet 22%
  • chat 16%
  • agent 6%
  • python 1%

Makes the model say

oldString<|tool_call_end|>?"initial showedful told?".

Makes it not say

$⏎ But play`'t will be

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 6.25
    Jim asked, "Why are you sad, Sue?" Sue said, "I lost my toy
  2. story 5.48
    . Sam saw Tim's sad face and asked what was wrong.⏎Tim showed Sam his broken
  3. story 5.41
    room. "Why are you crying, Mia?" Mom asked.⏎"I miss Navy
  4. story 5.35
    Mia asked, "What are you doing, Grandma?" Grandma said, "I am picking
  5. story 5.33
    . She asked, "What's wrong, Tim?" Tim told her about his dream. His
  6. chat 5.19
    and asked, "Why are you sad, Sue?" Sue said, "I lost my toy
  7. story 5.17
    . Tim asked, "What's wrong, Sue?" Sue said, "I can't find
  8. story 5.15
    . Willy saw Bob was sad and asked, "Why are you sad, Bob?" Bob
  9. story 5.02
    . They asked her what was wrong. She told them about the boy and
  10. story 4.93
    tree. Tom asked, "Why are you sad?" Tim said, "I lost my toy
  11. story 4.88
    Why are you sad?" asked Finny
  12. story 4.84
    itch asked, "Why are you sad?" The little girl said, "I lost my toy