Skip to content
mini-lab
Features of prelude-2

Feature #484

Fires on “,” (not labeled yet: read the examples)

Fires on
0.55% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 85%
  • chat 10%
  • agent 4%
  • python 1%
  • worksheet 0%

Makes the model say

something one other it their they the a

Makes it not say

didn did forgot liked:us wasth

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 5.02
    happy. They played with the fixed toy all day.⏎But then, something unexpected happened.
  2. story 4.97
    was still alert. Then, the rabbit heard a
  3. story 4.93
    sad and didn't know what to do. But then, the dog came back
  4. story 4.91
    could not find it. Tom and Sue were very sad.⏎Then, a big wave came
  5. story 4.89
    Tim was happy to have a new friend.⏎But then, the sky turned dark
  6. story 4.86
    the toy anywhere. The little bird started to cry.⏎Then, the unique crocodile had
  7. story 4.85
    it. He was very happy.⏎Then, Spot saw a boy
  8. story 4.72
    , feeling much less worried.<|bos|>Billy was playing with his sack when his dad walked up
  9. story 4.68
    were playing with the basketball. They were very happy. But then, something unexpected happened.
  10. story 4.66
    together. They were very happy.⏎But then, something unexpected happened.
  11. story 4.63
    there was a little boy named Sam. He was walking around his garden when he noticed something strange
  12. chat 4.62
    . She felt sad. Then, she closed her eyes