Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #2110

Fires on “ch” (not labeled yet: read the examples)

Fires on
1.09% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 80%
  • story 14%
  • python 3%
  • chat 2%
  • worksheet 0%

Makes the model say

<|think_start|> laughedize seek<|think_end|>ish dancedOK

Makes it not say

un insteadFix:u]) re items

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 2.43
    a time, there was a lawyer. He liked to march. One day,
  2. story 2.31
    Tim had a toy army. The toy army liked to march. One day,
  3. story 2.29
    to march around the playroom with his friends. They would march up and down,
  4. story 2.05
    From that day on, Tim, Sally, and their friends would march around the playroom
  5. story 2.03
    other. They were very patient as they walked. They liked to march together to find food
  6. story 2.03
    ing in a line. The oven thought, "I want to march like the ants!"
  7. story 2.02
    was so thankful to the prince for the treat. They all cheered, thanked him
  8. story 2.01
    ic.⏎Lily had a successful tea party with her friends. They all had a great time
  9. story 1.95
    ⏎Fin's mom told everyone in the sea about the problem. They all tried to clean the
  10. story 1.95
    said, "Don't be sad, oven. You may not march like the ants,
  11. story 1.93
    for the lion to come out. When the lion came out, they all jumped out and shouted
  12. story 1.9
    dancing made everyone in the house want to dance too. So, they all joined in and danced