Skip to content
mini-lab
Features of prelude-2

Feature #1282

Fires on “("” (not labeled yet: read the examples)

Fires on
0.52% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 38%
  • agent 20%
  • python 18%
  • chat 17%
  • worksheet 7%

Makes the model say

schema* its⏎ RenamedreplaceAllAnsweroldString

Makes it not say

se. big play toys boy named7

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. agent 2.88
    tiny language model trained from scratch on a laptop.
  2. python 2.82
    from greetings import count_vowels, hello⏎⏎assert count_vowels("house") ==
  3. python 2.82
    3⏎assert size("hello") == 5⏎assert initial("banana") == "
  4. python 2.82
    ⏎assert count_vowels("hello") == 2⏎assert initial("sun") == "
  5. chat 2.54
    .<|assistant_end|><|user_start|>tell me a story about a boat<|user_end|><|assistant_start|>Once upon a time, there
  6. python 2.48
    import last_letter, vowels, reverse⏎⏎assert last_letter("apple") == "
  7. python 2.48
    _letter("river") == "r"⏎assert count_vowels("star") ==
  8. python 2.47
    ⏎assert backwards("pizza") == "azzip"⏎assert backwards("lemon") == "
  9. python 2.47
    # main.py⏎from strings import shout⏎⏎print(shout("river"))⏎⏎
  10. chat 2.46
    7.<|assistant_end|><|bos|><|system_start|>Answer in one short sentence.<|system_end|><|user_start|>Once upon a time...
  11. chat 2.45
    happily ever after.<|bos|><|user_start|>Tell me a story.<|user_end|><|assistant_start|>Once upon a time, there
  12. python 2.45
    ⏎⏎assert initial("hello") == "h"⏎assert initial("river") == "