Skip to content
mini-lab
Features of prelude-2

Feature #2872

Fires on “'s” (not labeled yet: read the examples)

Fires on
0.04% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 40%
  • chat 25%
  • agent 20%
  • python 14%
  • worksheet 2%

Makes the model say

Fix```python trainedprinthtpy't

Makes it not say

id worry( feeling After She([ing

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 1.61
    her mommy and asked her to help. Olive's mommy got a knife
  2. agent 1.53
    , what does negate return?
  3. story 1.52
    smiled and the two of them quickly enter the water. To Tommy's delight, huge beautiful
  4. story 1.49
    they decided to share it. They touched the stone together and, to their surprise, they both
  5. chat 1.29
    <|assistant_end|><|user_start|>Hi!<|user_end|><|assistant_start|>Hi there! Would you like a story, or some numbers
  6. story 1.24
    ⏎One day he asked his dad to take him to the museum. His dad said no because
  7. story 1.24
    m was gone forever, and the town was never
  8. story 1.24
    the hammer to hit the box near where the knob was. To her surprise, the box
  9. python 1.19
    7]))⏎⏎$ python3 script.
  10. python 1.19
    1]))⏎⏎$ python3 hello.
  11. story 1.18
    He says, "Wow, look at that wave! It is so big and blue!"⏎
  12. chat 1.18
    Hello<|user_end|><|assistant_start|>Sure! Hi there! Would you like a story, or some numbers