Skip to content
mini-lab
Features of prelude-2

Feature #112

Fires on “pl” (not labeled yet: read the examples)

Fires on
0.03% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 37%
  • chat 25%
  • python 20%
  • worksheet 11%
  • agent 7%

Makes the model say

"!"python⏎⏎ together plusMaxreeone

Makes it not say

old always special I o fish onlyra

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 1.01
    , "Look, I found a twig! I want to display it in our
  2. chat 0.99
    <|assistant_end|><|user_start|>Goodbye!<|user_end|><|assistant_start|>Goodbye! Have a nice day.<|assistant_end|><|bos|>#
  3. story 0.96
    car won the race. The wagon felt sad and went back to supply food to the
  4. chat 0.96
    was big and yummy. He wanted to display the cake for
  5. story 0.95
    Tom nod. They say, "Thank you, Mama." They hug Mama. They hug
  6. story 0.93
    You are a graceful baby doll. You are so pretty and sweet." She put her baby doll
  7. story 0.93
    fun. Let's clean up the ink. Then we can go outside and play with the pen
  8. story 0.91
    day, a boy named Tim saw the hoop. He wanted to display the hoop for
  9. chat 0.89
    today?<|assistant_end|><|user_start|>Bye<|user_end|><|assistant_start|>Goodbye! Have a nice day.<|assistant_end|><|user_start|>what
  10. story 0.89
    the skeleton away and said goodbye. Tom went to bed and had a big
  11. story 0.89
    have a tea party with her friends. So, she decided to supply all the cup
  12. story 0.88
    . It was a big dog! The dog was friendly and wagged its tail. Sue was not