Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #114

Fires on “ down” (not labeled yet: read the examples)

Fires on
0.17% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 78%
  • chat 9%
  • agent 7%
  • python 5%
  • worksheet 0%

Makes the model say

next like forst on and at all

Makes it not say

idea<|arg|><|think_end|><|user_start|> calculator<|assistant_start|>("":

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 5.08
    tree. Tim's mom said it was a good idea. They sat down and took out the
  2. story 4.53
    Max ran and ran, and soon he was very tired. He sat down under the tree to
  3. story 4.47
    tail. He was happy to see the sunset too. They sat down on the soft grass
  4. story 4.42
    .⏎After playing for a while, they got tired. They sat down and talked. Tim
  5. story 4.42
    told her to relax and take her time. So, Lily sat down and looked at her
  6. story 4.37
    fix it together, Mia."⏎So, Mia and her mommy sat down in the room and
  7. story 4.33
    . One day, Mommy Bunny told her little bunnies to lay down for a nap.
  8. story 4.32
    When Lily got home, she called her friends over. They all sat down and drank the wild
  9. story 4.25
    Lily and Tom were hungry after playing for a long time. They sat down on a bench to
  10. story 4.25
    it out. The pie smelled great.⏎Lucy and her mom sat down to eat the pie
  11. story 4.15
    .⏎When it was time to eat, Lily and her mom sat down at the
  12. story 4.14
    's family was so happy that she saved the cake. They all sat down and enjoyed the delicious