Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #618

Fires on “-” (not labeled yet: read the examples)

Fires on
0.45% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 63%
  • worksheet 16%
  • chat 15%
  • story 5%
  • python 1%

Makes the model say

ra<|tool_call_start|>J (evens timeil only

Makes it not say

away together. nowrement()` back Sue

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 4.08
    <|bos|><|user_start|>I want a story!<|user_end|><|assistant_start|>Max was a nosy three-year-old
  2. story 4.02
    decorate the house!⏎Mother and Father took their three-year-old
  3. story 3.61
    upon a time there was a little girl named Lucy. She was three-years-old
  4. story 3.56
    have to be slow.⏎Mom gave Lily a hug and a band-aid. She said
  5. story 3.49
    , there was a little girl called Mary. Mary was three-years-old
  6. story 3.33
    and showed her the scratch. Her mom hugged her and put a band-aid on her arm
  7. story 3.32
    and showed her the scratch. Her mom hugged her and put a band-aid on her arm
  8. agent 3.29
    .py<|tool_call_end|><|assistant_end|><|tool_start|>Read file tools.py, lines 1-2⏎1:
  9. agent 3.28
    .py<|tool_call_end|><|assistant_end|><|tool_start|>Read file lib.py, lines 1-6⏎1:
  10. agent 3.25
    .py<|tool_call_end|><|assistant_end|><|tool_start|>Read file core.py, lines 1-2⏎1:
  11. agent 3.25
    .py<|tool_call_end|><|assistant_end|><|tool_start|>Read file core.py, lines 1-6⏎1:
  12. story 3.25
    min(nums)`. The tests pass now.<|assistant_end|><|bos|>Sara was three-years-old