Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #545

Fires on “ upon” (not labeled yet: read the examples)

Fires on
0.37% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 69%
  • chat 23%
  • agent 8%
  • python 1%
  • worksheet 0%

Makes the model say

m m ace Ben Lily Boba

Makes it not say

matterdefsquared example<|think_end|>The hurt way

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 3.02
    py`.<|assistant_end|><|bos|>Once upon a time, there
  2. story 2.94
    <|bos|>Once upon a time, there
  3. story 2.94
    <|bos|>Once upon a time, there
  4. story 2.94
    <|bos|>Once upon a time, there
  5. story 2.94
    <|bos|>Once upon a time, there
  6. story 2.94
    <|bos|>Once upon a time, in
  7. story 2.94
    <|bos|>Once upon a time, there
  8. story 2.93
    to show everyone back home!<|bos|>Once upon a time, in
  9. story 2.89
    and Tim learned that sharing with others can make everyone happy.<|bos|>Once upon a time, there
  10. story 2.84
    ⏎ return s + "!"⏎```⏎<|bos|>Once upon a time, in
  11. story 2.84
    ```<|assistant_end|><|bos|>Once upon a time, there
  12. story 2.83
    not quarrel anymore, and they were happy.<|bos|>Once upon a time, there