Skip to content
mini-lab
Features of prelude-2

Feature #3934

Fires on “ up” (not labeled yet: read the examples)

Fires on
0.95% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 59%
  • agent 31%
  • chat 6%
  • python 3%
  • worksheet 1%

Makes the model say

.<|bos|> end morend she her his

Makes it not say

"!"":ally Trydivides <_*.calculator

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 2.61
    the big cloud was in the way.⏎The sun did not give up. It kept trying
  2. story 2.54
    st. It was very hard to open, but they did not give up.⏎Finally,
  3. story 2.52
    with us, not on the moon."⏎The spoon did not give up. It kept trying
  4. story 2.48
    is to always ask for help when you need it, and never give up.<|bos|>Bug:
  5. story 2.44
    but the laces would not stay together. But Tim did not give up. He used his
  6. story 2.39
    and harder. Max was very tired, but he did not give up. Finally, Max
  7. story 2.38
    knew who it belonged to. They were about to give up when something strange happened
  8. chat 2.33
    moral of the story is to always listen to wise friends and never give up.<|assistant_end|><|bos|><|system_start|>
  9. story 2.25
    days ago. Tim was very persistent and would not give up. He looked and
  10. story 2.22
    it did not open. They were sad, but they did not give up. They decided to
  11. story 2.14
    the tree, but the wind was strong. The bird did not give up. He tried again
  12. chat 2.13
    's wing. It took a long time, but Mia did not give up.⏎When Mia