Skip to content
mini-lab
Features of prelude-2

Feature #1086

Fires on “ st” (not labeled yet: read the examples)

Fires on
1.49% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 40%
  • worksheet 22%
  • python 14%
  • chat 13%
  • story 11%

Makes the model say

function<|assistant_end|>script wayfegevowelstail

Makes it not say

"`.#(- example inside⏎ ze

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 3.01
    , "Help! Help! I am scared!" Ben runs down the stairs. He sees
  2. story 2.96
    ic door and check out what was inside. He started to climb the stairs and he noticed
  3. chat 2.94
    . The princess was curious, so she ran up the stairs to invest
  4. story 2.93
    around the house, in and out of rooms, up and down stairs, and all
  5. chat 2.92
    and over again. The princess was curious, so she ran up the stairs to invest
  6. story 2.9
    never find me there." She opens the door and goes down the stairs.⏎The
  7. story 2.88
    yellow slide. It looked so inviting, so Molly ran up the stairs and zoomed
  8. story 2.82
    The train's job was to attach carts and take them to the station. One day
  9. story 2.68
    up and up. She was curious. She wanted to go up the stairs. She left
  10. python 2.67
    sum_list` should add
  11. story 2.65
    doll. She was happy. She was brave. She had climbed the stairs.<|bos|>Once
  12. story 2.57
    shouts.⏎But Ben does not listen. He runs down the stairs and out of