Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #2493

Fires on “ the” (not labeled yet: read the examples)

Fires on
0.87% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 85%
  • chat 5%
  • worksheet 4%
  • story 3%
  • python 3%

Makes the model say

replaceAll<|tool_call_end|>⏎⏎0ree overenab

Makes it not say

Once it becauseAddeditem plusAdd difference

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 3.27
    018.⏎Find the sum of 1
  2. worksheet 3.13
    321 + 5 = 326.⏎Find the sum of 9
  3. chat 3.1
    <|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>Find the sum of 4
  4. worksheet 3.08
    9153 is 9199.⏎Find the sum of 6
  5. worksheet 3.02
    78 + 5 = 2183.⏎Find the sum of 3
  6. agent 2.96
    _arith.py<|arg|>oldString=positive<|arg|>newString=is_positive<|arg|>replaceAll=tr
  7. story 2.89
    little boy. They all played together and had a great time. In the end, Max learned
  8. worksheet 2.87
    add numbers, step by step or with a calculator.<|assistant_end|><|bos|>Find the sum of 6
  9. chat 2.86
    now.<|assistant_end|><|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>Find the sum of 8
  10. agent 2.86
    <|arg|>oldString=sum_two<|arg|>newString=my_sum_two<|arg|>replaceAll=tr
  11. worksheet 2.84
    6189 = 67058.⏎Find the sum of 9
  12. chat 2.81
    <|system_start|>You are mini, a small and friendly assistant.<|system_end|><|user_start|>Find the sum of 7