Skip to content
mini-lab
Features of prelude-2

Feature #1509

Fires on “⏎” (not labeled yet: read the examples)

Fires on
3.47% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 63%
  • chat 28%
  • agent 4%
  • python 4%
  • story 2%

Makes the model say

⏎ Lookprintnegate coderayAddedone

Makes it not say

th cannot carff gonea cried([

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 5.11
    went away.<|bos|>Calculate 200 + 2.⏎200+
  2. worksheet 4.83
    2.⏎Add 17003 and 6.⏎1700
  3. worksheet 4.48
    34⏎How much is 800 + 2?⏎800+
  4. worksheet 4.36
    83.⏎What's 200 + 8?⏎200+
  5. chat 4.16
    .<|system_end|><|user_start|>Compute 1+90<|user_end|><|assistant_start|><|think_start|>01+90:
  6. worksheet 4.14
    stories and add numbers.<|assistant_end|><|bos|>30 plus 20 equals 50.⏎
  7. chat 4.05
    <|user_start|>what is 76+90<|user_end|><|assistant_start|><|think_start|>76+90:
  8. python 3.98
    x // 2⏎```⏎⏎>>> half(10)⏎5⏎⏎```
  9. chat 3.98
    is 97 + 40?<|user_end|><|assistant_start|><|think_start|>97+40:
  10. worksheet 3.96
    .⏎Add 18008 and 24.⏎1800
  11. chat 3.95
    Add 34 and 80.<|user_end|><|assistant_start|><|think_start|>34+80:
  12. chat 3.94
    <|system_end|><|user_start|>4 + 90 = ?<|user_end|><|assistant_start|><|think_start|>04+90: