Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #1601

Fires on “-” (not labeled yet: read the examples)

Fires on
0.35% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 50%
  • story 28%
  • python 10%
  • chat 10%
  • worksheet 1%

Makes the model say

- -sse surevy name

Makes it not say

<|think_end|><|assistant_end|><|think_start|>Oneng idea:`Fixed

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 6.97
    decorate the house!⏎Mother and Father took their three-year-old
  2. chat 6.81
    <|bos|><|user_start|>I want a story!<|user_end|><|assistant_start|>Max was a nosy three-year-old
  3. story 6.31
    upon a time there was a little girl named Lucy. She was three-years-old
  4. story 6.17
    , there was a little girl called Mary. Mary was three-years-old
  5. story 5.71
    happy that she could trust the dog. She felt like a grown-up for doing something
  6. story 5.68
    min(nums)`. The tests pass now.<|assistant_end|><|bos|>Sara was three-years-old
  7. story 5.62
    her doll. She worked very hard and wanted to be a grown-up soon.⏎
  8. story 5.61
    were playing in the bathroom. They liked to pretend they were grown-ups and use
  9. story 5.43
    and clapped their hands.⏎One sunny day, while playing peek-a-boo
  10. story 5.37
    to fill with all his toys. One day, Tim saw a weird-looking bug
  11. chat 5.36
    thing to wear.⏎One day, the princess wanted to play dress-up. She put
  12. story 5.35
    ice-cream so much. One day, she saw a big ice-cream shop. Lily