Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #1776

Fires on “:” (not labeled yet: read the examples)

Fires on
0.49% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 62%
  • chat 28%
  • story 4%
  • worksheet 3%
  • python 2%

Makes the model say

adds get sum defined time bedFalse best

Makes it not say

they They together downThey themse tests

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 2.96
    anymore. The big, mean monster had won.<|bos|><|user_start|>Could you tell me what 3
  2. chat 2.86
    The dragon was interesting because it had many colors.<|assistant_end|><|user_start|>Could you tell me what 9
  3. chat 2.84
    py`, line 9.<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|system_start|>Do
  4. agent 2.82
    on, they had many fun adventures.<|assistant_end|><|bos|><|system_start|>tools: edit, glob
  5. chat 2.81
    mom.<|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>Could you tell me what 1
  6. agent 2.78
    96.<|assistant_end|><|bos|><|system_start|>tools: edit, glob
  7. agent 2.76
    3987 = 3999.<|bos|><|system_start|>tools: edit, glob
  8. chat 2.75
    they went home with big smiles on their faces.<|bos|><|user_start|>Could you tell me what 8
  9. chat 2.74
    + 42 = 7943.<|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>Hey
  10. chat 2.74
    985 = 1656.<|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>Calculate
  11. agent 2.74
    9 + 90 = 129.<|bos|><|system_start|>tools: edit, glob
  12. worksheet 2.73
    I can only tell short stories and add numbers.<|assistant_end|><|bos|>Could you tell me what 9