Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #1003

Fires on “ a” (not labeled yet: read the examples)

Fires on
0.49% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 52%
  • python 19%
  • chat 18%
  • agent 6%
  • worksheet 5%

Makes the model say

never, namedite lovedYou])]

Makes it not say

opencoderement1<|tool_call_end|> (ch prelude>>>

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 3.5
    <|assistant_end|><|bos|>Once upon a time, there was
  2. story 3.42
    ```<|assistant_end|><|bos|>Once upon a time, there was
  3. story 3.41
    py`.<|assistant_end|><|bos|>Once upon a time, there was
  4. story 3.4
    0, 105<|think_end|>105<|assistant_end|><|bos|>Once upon a time, there was
  5. story 3.39
    <|bos|>Once upon a time, there was
  6. story 3.39
    <|bos|>Once upon a time, there was
  7. story 3.39
    <|bos|>Once upon a time, there was
  8. story 3.39
    <|bos|>Once upon a time, there was
  9. story 3.39
    <|bos|>Once upon a time, in a
  10. story 3.39
    <|bos|>Once upon a time, there was
  11. story 3.35
    0.<|assistant_end|><|bos|>Once upon a time, there was
  12. story 3.33
    to show everyone back home!<|bos|>Once upon a time, in a