Skip to content
mini-lab
Features of prelude-2

Feature #356

Fires on “?” (not labeled yet: read the examples)

Fires on
0.65% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 40%
  • chat 22%
  • python 21%
  • agent 8%
  • story 8%

Makes the model say

!?"i!"⏎ wishThere boat

Makes it not say

max He than coming loves floorStopBye

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 2.57
    ⏎Hey, what's 4 plus 41402?⏎000
  2. worksheet 2.49
    .⏎What's 813 + 3180?⏎081
  3. worksheet 2.34
    3.⏎What's 4 + 39950?⏎000
  4. worksheet 2.33
    9.⏎What is 66 + 8434?⏎006
  5. worksheet 2.33
    What is the sum of 8 and 27237?⏎000
  6. worksheet 2.3
    ⏎What is 9852 + 3806?⏎985
  7. chat 2.25
    <|assistant_end|><|user_start|>what are you good at<|user_end|><|assistant_start|>I'm prelude, and I know how to tell
  8. worksheet 2.24
    Hey, what's 42 plus 23982?⏎000
  9. worksheet 2.23
    2.⏎What is 19 + 7234?⏎001
  10. worksheet 2.23
    ⏎What is 8482 + 6886?⏎848
  11. worksheet 2.21
    .⏎What is 835 + 9002?⏎083
  12. worksheet 2.2
    2.⏎What is 6 + 91036?⏎000