Skip to content
mini-lab
Features of prelude-2

Feature #3667

Fires on “ test” (not labeled yet: read the examples)

Fires on
0.35% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 52%
  • python 42%
  • story 4%
  • chat 1%
  • worksheet 0%

Makes the model say

pythonyHOnce( any hisSure

Makes it not say

Let⏎ They ideaLet)): characters

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. python 4.6
    88<|think_end|>The answer is 88.<|assistant_end|><|bos|># test_lists.py
  2. python 4.57
    =9, 910<|think_end|>910<|assistant_end|><|bos|># test_textlib.py
  3. python 4.26
    . I can only tell short stories and add numbers.<|assistant_end|><|bos|># test_number_utils
  4. python 4.2
    21 + 6 = 9127.<|bos|># test_listlib.py
  5. python 4.18
    <|user_end|><|assistant_start|>Goodbye! Have a nice day.<|assistant_end|><|bos|># test_lists.py
  6. python 4.12
    what you love is more important than having many things.<|assistant_end|><|bos|># test_calc.py
  7. python 4.11
    They played and studied the forest together every day.<|bos|># test_number_utils
  8. python 4.11
    I only know how to tell stories and add numbers.<|assistant_end|><|bos|># test_helpers.py
  9. python 4.11
    to playing, knowing that they were safe and happy together.<|bos|># test_tools.py
  10. python 4.07
    75⏎7 plus 6 is 13.<|bos|># test_items.py
  11. python 4.06
    + 448 = 4973.<|bos|># test_text.py
  12. python 4.05
    prints:⏎```⏎True⏎12⏎```<|assistant_end|><|bos|># test_helpers.py