Skip to content
mini-lab
Features of prelude-2

Feature #509

Fires on “Do” (not labeled yet: read the examples)

Fires on
0.76% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 47%
  • chat 32%
  • python 10%
  • story 7%
  • worksheet 5%

Makes the model say

blue checks<|system_end|>w Pythonularnd trained

Makes it not say

iceWe# feel0 do They import

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. python 2.79
    , 6, 3, 7, 7]) == 30⏎print
  2. chat 2.54
    asking me for a story!<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|system_start|>Do not use the calculator
  3. chat 2.48
    They had a great day.<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|system_start|>Do not use the calculator
  4. chat 2.42
    story to tell his friends.<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|system_start|>Do not use the calculator
  5. story 2.41
    a time there were two children, Joe and Ella. Joe had grown many ears of
  6. python 2.39
    _list([6, 9, 7, 9])⏎3
  7. chat 2.37
    is 172.<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|system_start|>Do not use the calculator
  8. worksheet 2.32
    07 + 73 = 8880.⏎Hey, what's
  9. worksheet 2.31
    9 + 252 = 261.⏎Hey, what's
  10. chat 2.31
    the hard work they had done!<|bos|><|system_start|>tools: calculator<|system_end|><|system_start|>Do not use the calculator
  11. chat 2.31
    ised that dreams can come true.<|bos|><|system_start|>tools: calculator<|system_end|><|system_start|>Do not use the calculator
  12. chat 2.3
    09<|think_end|>509<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|system_start|>Do not use the calculator