Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #1249

Fires on “ v” (not labeled yet: read the examples)

Fires on
0.56% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 42%
  • python 28%
  • story 28%
  • chat 2%
  • worksheet 1%

Makes the model say

alely<|think_end|> kept```ide train Just

Makes it not say

longek arrived moment other subtractM(

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 4.28
    continued their tea party, laughing and having fun, knowing they learned a valuable lesson
  2. story 4.19
    despite his increased popularity. They both learned a valuable lesson
  3. story 4.07
    man was testing their bravery and wanted to teach them a valuable lesson
  4. story 3.76
    , you can fly too. Just try and you will see the nice view." Tim
  5. story 3.72
    were happy and thanked Joy.⏎Joy learned a valuable lesson
  6. story 3.71
    to respect other people's privacy."⏎Bob learned a valuable lesson
  7. story 3.61
    to see the bird. I love animals. I want to be a veterinarian
  8. story 3.21
    game.<|assistant_end|><|bos|>Jenny loved animals. She wanted to be a veterinarian
  9. story 3.17
    <|bos|>Anna loved animals. She wanted to be a veterinarian
  10. story 3.15
    .⏎One day, Speedy saw his friends watching a video. It
  11. story 3.11
    was very proud of Ralph for wanting to protect something so valuable.
  12. story 3.1
    . Lily laughed and said, "All people have two legs, silly vine!"⏎Lily