Skip to content
mini-lab
Features of prelude-2

Feature #4073

Fires on “ a” (not labeled yet: read the examples)

Fires on
0.72% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 42%
  • chat 39%
  • agent 14%
  • python 6%
  • worksheet 0%

Makes the model say

time soony special s])` mually

Makes it not say

next say all around()`.demo barked

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 4.11
    can you tell me a story about a dragon<|user_end|><|assistant_start|>Once upon a time, there was
  2. story 4.1
    with `final_letter(s)`.<|assistant_end|><|bos|>Once upon a time, there was
  3. story 4.09
    much!<|user_end|><|assistant_start|>Sure! You're welcome!<|assistant_end|><|bos|>Once upon a time, in a
  4. story 4.08
    fun day playing with the treasure in the park.<|assistant_end|><|bos|>Once upon a time there was a
  5. story 4.08
    0, 105<|think_end|>105<|assistant_end|><|bos|>Once upon a time, there was
  6. chat 4.08
    and fix the Python files in this project.<|assistant_end|><|bos|><|user_start|>Once upon a time...<|user_end|>
  7. story 4.07
    add numbers. Try asking me for a story!<|assistant_end|><|bos|>Once upon a time, in a
  8. chat 4.06
    about a dragon.<|user_end|><|assistant_start|>Once upon a time, there was
  9. story 4.06
    <|assistant_end|><|bos|>Once upon a time, there was
  10. story 4.06
    py`.<|assistant_end|><|bos|>Once upon a time, there was
  11. chat 4.06
    .<|bos|><|system_start|>Start every answer with "Sure!".<|system_end|><|user_start|>Once upon a time...<|user_end|>
  12. story 4.05
    edit and fix the Python files in this project.<|assistant_end|><|bos|>Once upon a time, there was