Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #2706

Fires on “ with” (not labeled yet: read the examples)

Fires on
1.03% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 47%
  • agent 23%
  • chat 12%
  • python 12%
  • worksheet 6%

Makes the model say

<|bos|> the sorry= +( %[-

Makes it not say

first working strings another moralstrings"atter

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 5.32
    by step or with a calculator.<|assistant_end|>
  2. agent 5.18
    with a function hello that
  3. story 5.18
    with a long string.
  4. story 5.18
    with me?"⏎Tommy
  5. story 5.18
    with an arrow on it
  6. chat 5.18
    with "Sure!".<|system_end|>
  7. story 5.18
    with many birds on it
  8. chat 5.18
    with the number only.
  9. story 5.18
    with the sticks. He
  10. chat 5.18
    with the number only.
  11. chat 5.18
    with the lemon. It
  12. agent 5.18
    with `final_letter