Skip to content
mini-lab
Features of prelude-2

Feature #3834

Fires on “ So” (not labeled yet: read the examples)

Fires on
0.33% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 80%
  • chat 16%
  • agent 2%
  • python 2%
  • worksheet 1%

Makes the model say

, And So theySoOnce Now them

Makes it not say

): typoEADMEopencodeitalcalculator:`. shouted

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 4.99
    looks like a fun place to play!" So, he ran to
  2. story 4.91
    We all make mistakes. Let's keep playing and having fun!" So, the big cat
  3. story 4.88
    said, "Yes, Tornado! Let's play together!" So, Tornado
  4. story 4.83
    's a big one! Let's clean it and share it." So, they took the
  5. story 4.8
    , "Let's build the nest in my big, warm barn!" So they did, and
  6. story 4.78
    "Let's include all our friends and watch the film together!" So, they went to
  7. story 4.77
    . Let's wrap a rope around it and pull it together." So, they found a
  8. story 4.7
    , "Yes, it is! Let's dance with the puzzle!" So, Mia, her
  9. chat 4.69
    help you. Follow me, and we will go together." So, Sam and Tim
  10. story 4.65
    play too?" Tim said, "Yes, let's play together!" So, they took turns
  11. story 4.63
    had an idea. "Let's learn how to fix it together!" So, all the kids
  12. story 4.46
    said, "I don't know, but let's find out!" So, Dee and