Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #698

Fires on “ ” (not labeled yet: read the examples)

Fires on
0.80% of tokens
Mostly in
python
Layer
after block 4

Where it fires

  • python 51%
  • chat 14%
  • worksheet 13%
  • agent 12%
  • story 11%

Makes the model say

SueOnceSue Lily add Herup<|assistant_start|>

Makes it not say

forever We away smiledfromWe wemain

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 2.11
    in the park. He was jumping from
  2. chat 1.96
    was a grumpy boat. The boat was always
  3. story 1.96
    and the cow had a race. They wanted to see who was the fastest.⏎The
  4. chat 1.94
    , there was a big dragon. The dragon was very
  5. story 1.87
    Red, "Let's have a race to see who is the fastest!" Red
  6. chat 1.83
    <|system_start|>Do not use the calculator.<|system_end|><|user_start|>What is the sum of 3 and
  7. chat 1.81
    a little girl named Lucy went to the park with her parent. The sun was bright
  8. chat 1.78
    red shirt and blue pants.<|assistant_end|><|user_start|>What is the sum of 4 and
  9. story 1.78
    reddy wanted to become
  10. agent 1.78
    rep<|arg|>pattern=
  11. chat 1.76
    how to tell stories and add numbers.<|assistant_end|><|bos|><|user_start|>What is the sum of 17
  12. chat 1.75
    The answer is 1420.<|assistant_end|><|user_start|>What is the sum of 70