Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #145

Fires on “.” (not labeled yet: read the examples)

Fires on
1.65% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 64%
  • chat 19%
  • agent 10%
  • worksheet 4%
  • python 3%

Makes the model say

moral<|bos|> unexpectedOnce import end storyFixed

Makes it not say

you. boy k b friend let blue

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 4.47
    best of friends forever.<|bos|><|user_start|>Write a
  2. story 4.17
    . They played together every day, and they all lived happily ever after.<|bos|>One day,
  3. story 4.16
    cat learned to share and play together, and they became good friends.<|bos|><|system_start|>Answer with
  4. story 4.13
    played together and became best friends. And they all lived happily ever after.<|bos|><|system_start|>tools:
  5. story 4.02
    Everyone was happy and had a great time.<|bos|><|system_start|>tools:
  6. story 3.96
    it to play with her friend again. And they lived happily ever after.<|bos|>Once upon a
  7. story 3.94
    she could have with her toys. And they all lived happily ever after.<|bos|><|system_start|>tools:
  8. story 3.91
    even more fun.<|bos|><|system_start|>tools:
  9. story 3.87
    They learned that helping others can make you happy and bring you more friends.<|bos|><|system_start|>Start every
  10. story 3.86
    the world together.⏎When they finished
  11. story 3.85
    the best way to make friends. And they all lived happily ever after.<|bos|><|system_start|>tools:
  12. story 3.76
    together and became good friends. And the ant never