Skip to content
mini-lab
Features of prelude-2

Feature #1039

Fires on “ sad” (not labeled yet: read the examples)

Fires on
0.54% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 46%
  • story 43%
  • chat 6%
  • worksheet 3%
  • python 2%

Makes the model say

<|tool_call_end|>_ce<|system_start|> files againexc<|tool_call_start|>

Makes it not say

your you be always stay One keep here

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 2.68
    behind the couch.⏎By the end of the day, everyone forgot about the kitten.
  2. story 2.43
    again, but he couldn't make the ball move.⏎Max was sad. He wanted to
  3. story 2.17
    ⏎Tim was sad and went home.
  4. story 2.16
    water and became smaller and smaller until it was gone.⏎Fin was sad to see the ice
  5. story 2.16
    The cat grabbed the trumpet and ran away.⏎Anna was sad and hurt. She
  6. agent 2.15
    ^^^^^^^^^^^^^^^^^^^^^^^^^⏎AssertionError⏎⏎Exited with code 1<|tool_end|><|assistant_start|><|tool_call_start|>grep
  7. story 2.14
    could not. The shiny nail was too heavy for him. Bob was sad and did not know
  8. story 2.14
    's not safe. You must stay away from it."⏎Sue was sad but she listened to
  9. story 2.13
    A big wind came and blew the flower away.⏎Buzz was sad and asked his friend
  10. story 2.12
    't say anything, but it flew away into the tree. Max was sad and started to cry
  11. story 2.11
    played in the snow all day. They had so much fun that Tim forgot about the door.
  12. chat 2.1
    dog ran to Tom and his friends. They played with the dog and forgot about the car.