Skip to content
mini-lab
Features of prelude-2

Feature #602

Fires on “ each” (not labeled yet: read the examples)

Fires on
0.02% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 47%
  • agent 36%
  • python 8%
  • chat 7%
  • worksheet 2%

Makes the model say

`,ented other0 This very

Makes it not say

+") `<|assistant_start|>ice+HelloThank

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 1.15
    a new game. We have to remain in a line and follow each other. I will
  2. story 1.13
    ps. You have to be careful and tidy when you paint. That is how you show your
  3. story 1.12
    said, "Of course, you can. I have an idea. Why don't you help
  4. story 1.1
    the new lab! They were happy to be free and see the world. They played and
  5. story 1.06
    sack. One day, he went for a walk in the park
  6. story 1.04
    and went back to her dictionary. She looked at the word "bitter" again
  7. story 0.99
    Then, mom came into the living room. She heard the noises and saw Lily and Ben
  8. story 0.97
    tell me a joke?"⏎Jack chuckled and said, "Why did the chicken z
  9. story 0.91
    "You're welcome, Mia. I'm proud of you for learning something new."<|bos|>
  10. agent 0.91
    hlaf(7))⏎ ^^^^⏎NameError: name 'hlaf' is not
  11. story 0.91
    chest opened and they saw lots of pretty things inside. There were toys, balls, and
  12. story 0.88
    , their mom came home and saw the cooler in the backyard. She opened it and saw