Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #1784

Fires on “.” (not labeled yet: read the examples)

Fires on
0.31% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 47%
  • story 46%
  • chat 5%
  • python 2%
  • worksheet 0%

Makes the model say

`: gone them way<|think_end|> out Instead<|think_start|>

Makes it not say

named twofactorial manycubefactc our

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 2.02
    lights and the music. She saw the people in the seats. She felt excited.
  2. story 1.89
    Jack looked at all the things in the park. He saw the birds and the trees and the
  3. story 1.76
    friends to the stage. She sees the lights and the people. She feels nervous and
  4. story 1.64
    She saw them on the floor. She saw their sweaters. She saw their tears
  5. story 1.51
    they lovely?"⏎Sara looks at the book. She sees the flowers. They are different from
  6. story 1.49
    leaves dance!" Tim smiled and kept stirring the leaves. He liked making the leaves dance.
  7. story 1.48
    go to the park with his mom. He likes to see the birds that fly and sing.
  8. story 1.47
    .⏎When Tim got on the stage, he saw many kids. The kids were looking
  9. story 1.47
    eet," Lily said.⏎The birds heard them and looked at them. Some of them flew
  10. agent 1.46
    Hello, Noa!⏎<|tool_end|><|assistant_start|>Fixed the typo in `run.py`: `sm
  11. story 1.45
    . Its branches were empty and it looked like it had grown just for him. He
  12. agent 1.45
    ⏎Hello, Max!⏎<|tool_end|><|assistant_start|>Fixed the typo in `run.py`: `j