Skip to content
mini-lab
Features of prelude-2

Feature #104

Fires on “ ste” (not labeled yet: read the examples)

Fires on
2.30% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 72%
  • agent 16%
  • chat 8%
  • python 2%
  • worksheet 2%

Makes the model say

sers gonees thingsight townet

Makes it not say

+)`=**/*. pluscalculator<|user_end|> list Python

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 4.17
    gone!"⏎Tim had an idea. "Let's mix some new spicy food!" So,
  2. story 4.1
    , the little train practiced every day. It tried hard to make more steam and go faster
  3. story 3.97
    want to hold him?"⏎Ben looks at the bear. He likes bears. He nod
  4. story 3.8
    , there was a creative spider named Sally. Sally loved to make pretty webs in the
  5. story 3.78
    , in a big tree, there was a bee hive. Many bees lived there and
  6. story 3.56
    enter. It was a big pool of water with amazing colored lights and a gar
  7. story 3.54
    Tom and Lily were playing in their room. They liked to make funny shadows on the wall
  8. story 3.51
    ed to the tournament and found plenty of mighty steel pieces that he
  9. story 3.46
    to sleep. From that day on, Sally was never scared of monsters again.<|bos|>
  10. story 3.41
    time, there was a new magic toy. The toy could shoot pretty lights. It was
  11. story 3.4
    The airport was big and noisy. There were many people and planes.⏎At
  12. chat 3.35
    of the tree to see