Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #2951

Fires on “=” (not labeled yet: read the examples)

Fires on
2.24% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 64%
  • chat 16%
  • story 9%
  • python 8%
  • worksheet 3%

Makes the model say

mWow it this %hello=igh

Makes it not say

<|bos|>⏎<|assistant_end|>many test<|tool_start|> else<|arg|>

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. python 2.44
    .⏎⏎# hello.py⏎from strings import final_letter, count_vowels⏎
  2. python 2.43
    <|bos|># test_words.py⏎from words import exclaim, echo, last_letter⏎
  3. agent 2.39
    works! and run it.<|user_end|><|assistant_start|><|tool_call_start|>write<|arg|>path=run.py<|arg|>
  4. python 2.34
    pytest⏎⏎# main.py⏎from strings import join_words, welcome⏎⏎print
  5. agent 2.33
    that returns s in upper case.<|user_end|><|assistant_start|><|tool_call_start|>write<|arg|>path=greetings.py<|arg|>
  6. agent 2.33
    keeps only the even numbers.<|user_end|><|assistant_start|><|tool_call_start|>write<|arg|>path=lib.py<|arg|>
  7. agent 2.27
    , and backwards that reverses s<|user_end|><|assistant_start|><|tool_call_start|>write<|arg|>path=greetings.py<|arg|>
  8. agent 2.25
    works!" and run it.<|user_end|><|assistant_start|><|tool_call_start|>write<|arg|>path=greeting.py
  9. agent 2.24
    !" and run run.py.<|user_end|><|assistant_start|><|tool_call_start|>write<|arg|>path=run.py<|arg|>
  10. agent 2.21
    Hello, Ada!<|user_end|><|assistant_start|><|tool_call_start|>write<|arg|>path=demo.py<|arg|>
  11. agent 2.2
    , Zoe! and run it<|user_end|><|assistant_start|><|tool_call_start|>write<|arg|>path=hello.py<|arg|>
  12. agent 2.2
    va!, then run it.<|user_end|><|assistant_start|><|tool_call_start|>write<|arg|>path=greeting.py