Skip to content
mini-lab
Features of prelude-2

Feature #328

Fires on “ big” (not labeled yet: read the examples)

Fires on
1.02% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 61%
  • chat 18%
  • agent 16%
  • python 4%
  • worksheet 1%

Makes the model say

smile other smiles big new family smileddef

Makes it not say

with has' favorite lateient":test

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 5.65
    Lily knew her new watch was special. She went to bed with a big smile on her face
  2. story 5.61
    her fancy towel back. She hugged it tight and went home with a big smile on her face
  3. story 5.46
    They put the stone back in the box, and went home with a big smile, knowing they
  4. story 5.06
    get back to the surface. She swam back to land with a big smile on her face
  5. story 4.97
    and promised to come back soon. He started walking home, with a big smile on his face
  6. chat 4.83
    by step or with a calculator.<|assistant_end|><|user_start|>
  7. story 4.66
    , and Tim was not worried anymore. They all went home with a big smile.<|bos|><|user_start|>
  8. agent 4.54
    function combine in core.py. It joins a and b with a space.<|user_end|><|assistant_start|>
  9. story 4.53
    was happy that her doll could help her, and they went home with big smiles on their faces
  10. story 4.5
    ites with a pen on paper.
  11. chat 4.46
    or with a calculator.<|assistant_end|><|bos|>
  12. story 4.42
    favorite books and felt happy. They sat down and read their books with big smiles on their faces