Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #395

Fires on “.” (not labeled yet: read the examples)

Fires on
0.75% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 40%
  • worksheet 34%
  • chat 14%
  • agent 8%
  • python 4%

Makes the model say

. cried?"!" was did wanted cubed

Makes it not say

`Added ut<|arg|>()`nFixed

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 3.2
    66.⏎If you add
  2. worksheet 3.15
    67.⏎Lily had
  3. python 3.14
    6.3333
  4. worksheet 3.13
    43.⏎676
  5. worksheet 2.97
    5862.<|bos|><|system_start|>tools:
  6. worksheet 2.96
    598.⏎Compute 5
  7. chat 2.94
    267.<|assistant_end|><|user_start|>I want
  8. worksheet 2.94
    93.⏎4 +
  9. chat 2.93
    4.<|assistant_end|><|user_start|>what's
  10. worksheet 2.92
    078.⏎What is
  11. chat 2.89
    04.<|assistant_end|><|user_start|>Tell me
  12. chat 2.88
    35.<|user_end|><|assistant_start|>The answer