Skip to content
mini-lab
Features of prelude-2

Feature #373

Fires on “,” (not labeled yet: read the examples)

Fires on
0.65% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 81%
  • chat 12%
  • agent 4%
  • python 2%
  • worksheet 0%

Makes the model say

he she they⏎ He k] down

Makes it not say

()`:`Sorryjsonllo":ic trained

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 4.94
    , but he wanted to get his ball. So, he thought of a
  2. story 4.9
    leaf. He thought it would be fun to fold the leaf. So, he used his little
  3. story 4.75
    Max was curious and wanted to know what was inside the box. So, he went closer and
  4. story 4.63
    bird knew that the giant liked to sleep under a big tree. So, the bird waited for
  5. story 4.58
    thought and thought. Then, he had a big
  6. chat 4.56
    tree. He wanted to climb the tree with his wire. So, Tom took the w
  7. chat 4.55
    tree. He wanted to climb the tree with his wire. So, Tom took the w
  8. story 4.5
    kind. He wanted to help the bird. So, the cat and the
  9. story 4.49
    the bug looked stupid. He wanted to pinch the bug. So, he tried to pin
  10. story 4.45
    ⏎Tim wanted to keep playing and reading his magazine. So, he tried to hide
  11. story 4.44
    in a tree. The cable wanted to help the bird. So, it moved and moved
  12. story 4.38
    on the table and thought it was just a piece of paper. So, he took the paper