Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #1783

Fires on “ with” (not labeled yet: read the examples)

Fires on
2.16% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 76%
  • chat 14%
  • agent 7%
  • python 2%
  • worksheet 1%

Makes the model say

One things sun c There t red her

Makes it not say

expressionopencodereplaceAll<|think_end|><|tool_end|> typo forever`,

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 5.17
    Tim liked to watch the fish swim.
  2. chat 4.92
    , there was a little boy named Tim. Tim loved to play with his football.<|assistant_end|>
  3. chat 4.61
    time, there was a little boy named Tim. Tim loved to play with his red ball.
  4. story 4.52
    a time, there was a little boy named Tim. Tim liked to touch everything he saw.
  5. story 4.5
    time, there was a curious little girl named Lily. She loved to explore and look at everything
  6. story 4.49
    time, there was a little girl named Lily. She loved to play with her toys and eat
  7. story 4.48
    , there was a little boy named Tim. Tim loved to play outside with his friends all day
  8. story 4.45
    named Bob. Bob loved to play with his favorite toy,
  9. story 4.45
    , there was a thoughtful little girl named Lily. She loved to watch things grow in her
  10. story 4.45
    , there was a pale boy named Tim. Tim loved to play with his toy teleph
  11. story 4.45
    time, there was a little dog named Max. Max loved to play with his ball. One
  12. story 4.44
    , there was a clever dog named Max. Max loved to play ball on the pitch near