Skip to content
mini-lab
Features of prelude-2

Feature #3891

Fires on “,” (not labeled yet: read the examples)

Fires on
0.86% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 67%
  • python 13%
  • agent 10%
  • chat 8%
  • worksheet 3%

Makes the model say

went they go walked walk swim he agreed

Makes it not say

plusfrom away Suddenly homeatterhing hiding

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 2.79
    little boy named Tim. He lived in a small house with his mom, dad, and his
  2. story 2.6
    , but he wanted to get his ball. So, he thought of a
  3. story 2.55
    doubled.<|assistant_end|><|bos|>Tom and Lily went to the beach with their mom and dad. They liked
  4. story 2.47
    near the big tree, a little girl named Lily lived with her mom and dad. One day
  5. chat 2.43
    a distant house and wanted to go there. He asked his mom, "Can I go
  6. story 2.39
    little boy named Tim. Tim lived in a small house with his mom, dad, and dog
  7. story 2.34
    house. A little girl named Sally lived in the house with her mom and dad. Sally was
  8. chat 2.3
    a fair princess. She lived in a big castle with her mom and dad. The princess
  9. story 2.28
    was a small princess. She lived in a big castle with her mom and dad. The small
  10. story 2.28
    kind. He wanted to help the bird. So, the cat and the
  11. story 2.28
    normal boy named Tom. He lived in a small house with his mom and dad. Tom had
  12. story 2.26
    lived in a big castle with his mom, the queen. P