Skip to content
mini-lab
Features of prelude-2

Feature #2534

Fires on “ very” (not labeled yet: read the examples)

Fires on
0.59% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 76%
  • chat 12%
  • agent 11%
  • python 0%
  • worksheet 0%

Makes the model say

sad special important vcombine{ proud really

Makes it not say

(.?⏎⏎⏎ ?" them8

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 4.47
    Billy gave a big smile and nodded, feeling very excited.⏎When
  2. chat 4.34
    was very hungry. He wanted
  3. story 4.34
    was very happy he found the
  4. story 4.34
    was very dirty. It needed
  5. story 4.3
    Millie was very happy and very full
  6. story 4.22
    smiled and told Sue that it was her grandma's dress. Sue felt very happy and special.
  7. story 4.18
    <|bos|>One day, a little ball named Bouncy was feeling very sad. Bou
  8. story 4.16
    and Bella felt very happy. They loved
  9. story 4.13
    <|assistant_end|><|bos|>Once upon a time there was an old man. He was very elderly. He lived
  10. story 4.1
    said.⏎Joe felt very sad, so he
  11. story 4.08
    upon a time there was a young boy named Bob. He was a very curious boy and always
  12. story 4.07
    2` in `app.py`.<|assistant_end|><|bos|>Johnny was a very special boy. He