Skip to content
mini-lab
Features of prelude-2

Feature #1293

Fires on “ to” (not labeled yet: read the examples)

Fires on
0.21% of tokens
Mostly in
python
Layer
after block 4

Where it fires

  • python 58%
  • story 20%
  • agent 12%
  • chat 7%
  • worksheet 3%

Makes the model say

py30]+5 `B

Makes it not say

ic`. this`,incrementidemo big

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 2.31
    and laughed. They played until the sun went down and it was time to go home.⏎
  2. chat 1.94
    under a tree.<|assistant_end|><|user_start|>Bye<|user_end|><|assistant_start|>Goodbye! Have a nice day.<|assistant_end|>
  3. story 1.93
    ball and had lots of fun. After a while, it was time to go home. Lily
  4. story 1.88
    They have fun and make new friends. They sing until it's time to go home. They
  5. story 1.87
    went back to his friends. They all played catch until it was time to go home.⏎
  6. story 1.86
    new friend. They played with Quack until it was time to go home. They
  7. story 1.86
    .⏎Lilly and Mary talked and played until it was time to go to bed.
  8. chat 1.84
    calculator.<|assistant_end|><|user_start|>Goodbye!<|user_end|><|assistant_start|>Goodbye! Have a nice day.<|assistant_end|>
  9. chat 1.81
    help you today?<|assistant_end|><|user_start|>Bye<|user_end|><|assistant_start|>Goodbye! Have a nice day.<|assistant_end|>
  10. story 1.81
    ⏎Lily and Ben hugged Bob and played with him until it was time to go inside.⏎
  11. story 1.8
    laughed and barked, having lots of fun together. When it was time to go home, Lily
  12. story 1.79
    They all smiled and continued to play in the park until it was time to go home.<|bos|>