Skip to content
mini-lab
Features of prelude-2

Feature #1555

Fires on “ to” (not labeled yet: read the examples)

Fires on
0.61% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 47%
  • agent 28%
  • worksheet 11%
  • chat 8%
  • python 7%

Makes the model say

Onceice feel dayh `<|bos|> her

Makes it not say

can<|assistant_end|> strings could ran able running enough

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 5.92
    to play anymore. So
  2. story 5.92
    to pass.⏎H
  3. story 5.92
    to be different animals and
  4. story 5.92
    to mail the letter.
  5. story 5.92
    to gather sticks and
  6. story 5.92
    to eat. He asked
  7. story 5.92
    to the window and saw
  8. python 5.92
    to x.⏎⏎
  9. story 5.92
    to the park to play
  10. story 5.92
    to find the weight
  11. story 5.92
    to the print shop.
  12. story 5.92
    to go there. His