Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #359

Fires on “ by” (not labeled yet: read the examples)

Fires on
0.43% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 51%
  • story 33%
  • chat 12%
  • python 3%
  • worksheet 2%

Makes the model say

,e and old one it them s

Makes it not say

)`]``p<|arg|> testsoldString wagged

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 3.93
    by step or with a
  2. story 3.93
    bye to their friends
  3. agent 3.61
    a and b separated by a space.<|user_end|>
  4. story 3.34
    a time there was a little girl called Amy who loved to act all by herself. She was
  5. story 3.23
    who lived by the sea. One day, John went for a walk by the beach and disco
  6. story 3.17
    but it was too hard.⏎Just then, a nice lady walked by and saw the loud
  7. story 3.15
    from the van. They sat on a bench and watched the cars go by as Tim ate his
  8. story 3.14
    "Come, buy my toys!" Lisa called out to the people walking by. "They are
  9. agent 3.1
    <|system_start|>You are a title generator.<|system_end|><|user_start|>fix the bug caught by test_math_
  10. story 3.1
    ifi the frog lay in the mall, watching the people pass by. She was very
  11. story 3.1
    street and saw many things. Tim liked to watch all the cars go by. He saw a
  12. story 3.1
    . They were so peaceful and happy. They watched the clouds float by and the trees move