Skip to content
mini-lab
Features of prelude-2

Feature #1214

Fires on “,” (not labeled yet: read the examples)

Fires on
0.52% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 87%
  • story 11%
  • chat 1%
  • python 0%
  • worksheet 0%

Makes the model say

and,'s sk```as`One

Makes it not say

i adds)`.aking<|think_start|> timetxtfe

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 4.37
    the furniture. She danced on the chair, the table, and even the bed
  2. story 4.36
    the park with her mom. She played on the swings, the slide, and the see-
  3. story 4.2
    play with clay. She had many colors of clay like red, blue, and yellow. Lily
  4. story 3.93
    favorite toy, a long staff. He would run, jump, and bow to the
  5. story 3.81
    . They made a picture of a house, a tree, a dog, and a sun.
  6. agent 3.76
    , webfetch, websearch, write, execute
  7. story 3.75
    . Lucy liked to taste new things. She would taste fruits, vegetables, and even flowers.
  8. agent 3.73
    , webfetch, websearch, write, execute
  9. agent 3.72
    , webfetch, websearch, write, execute
  10. agent 3.7
    , webfetch, websearch, write, execute
  11. story 3.68
    to sort her toys. She had many different toys: dolls, cars, and blocks. One
  12. agent 3.68
    , webfetch, websearch, write, execute