Skip to content
mini-lab
Features of prelude-2

Feature #14

Fires on “<|user_end|>” (not labeled yet: read the examples)

Fires on
0.94% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 46%
  • agent 39%
  • story 12%
  • worksheet 3%
  • python 0%

Makes the model say

.?" says thing,"Tom one noise

Makes it not say

scriptThank trained` functionsSetritepath

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 3.25
    spotted something purple.⏎"Mommy, look! It's purple!" Mia said.⏎Her
  2. story 3.16
    on a folder. "Ouch!" she said. Amy hugged
  3. story 2.97
    on Mia's adventures. "Tom, let's find the treasure!" Mia said. Tom bl
  4. story 2.96
    a big box under a tree. "Wow, what is this?" she said. Mia felt
  5. agent 2.92
    [2, 2, 0] and run the script please<|user_end|><|assistant_start|><|tool_call_start|>gre
  6. story 2.9
    tree. "Don't worry, cat! I will save you!" he said. Tim got
  7. story 2.89
    a strange little animal in the garden. "What is that?", she asked her dad.
  8. agent 2.88
    file listlib.py with largest, which returns the largest number in nums<|user_end|><|assistant_start|>Create listlib.
  9. agent 2.88
    , a coding agent harness.<|system_end|><|user_start|>"Do the tests pass?"<|user_end|><|assistant_start|><|tool_call_start|>gl
  10. agent 2.83
    Use apple for WORD in hello.py and run the script."<|user_end|><|assistant_start|><|tool_call_start|>read<|arg|>
  11. agent 2.83
    a coding agent harness.<|system_end|><|user_start|>"Are the tests passing?"<|user_end|><|assistant_start|><|tool_call_start|>gl
  12. story 2.82
    Come on, Sara, help me build a sandcastle!" he called.⏎Sara