Skip to content
mini-lab
Features of prelude-2

Feature #52

Fires on “ went” (not labeled yet: read the examples)

Fires on
2.05% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 84%
  • chat 10%
  • agent 4%
  • python 2%
  • worksheet 1%

Makes the model say

up to many andus allitems red

Makes it not say

.? trained<|assistant_end|> anymore hurt<|user_end|>")

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 3.45
    was very hungry. He wanted to get some food. He went to the shop with
  2. chat 3.33
    . Tim was very hungry. He wanted to get some food. He went to the shop with
  3. story 3.31
    play his drawing. He wanted to show it to everyone. He went outside to put his
  4. story 3.14
    girl named Sally wanted to make a special dish for her mom. She went to the kitchen and
  5. story 3.1
    they decided to make a calendar for their mom. They used a big sheet
  6. story 3.09
    . They wanted to see what was inside the boxes.⏎They climbed on the truck and
  7. story 3.08
    adventure to find the best spot to bake her treats.⏎She walked and walked until she
  8. story 3.03
    in his room. He was looking for his toy car. He looked under his bed, but
  9. story 3.02
    adventure, so he decided to go exploring in the woods.⏎He walked for a long time
  10. chat 2.97
    wanted to find a way to make the wheel feel better.⏎They went to a kind man
  11. story 2.91
    it look nice, so she decided to polish it. Sue got a cloth and started to
  12. story 2.9
    find his toy car. So, he started a search. He looked in the toy box,