Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #3338

Fires on “ upon” (not labeled yet: read the examples)

Fires on
0.53% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 44%
  • worksheet 29%
  • chat 23%
  • python 2%
  • agent 2%

Makes the model say

5 divisiblerenopencode⏎ divides```py

Makes it not say

but ButBut and ideath whenion

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 3.3
    together.<|bos|>Once upon a time there was
  2. story 3.27
    0.<|assistant_end|><|bos|>Once upon a time, there
  3. story 3.26
    .<|assistant_end|><|bos|>Once upon a time there were
  4. story 3.26
    .<|assistant_end|><|bos|>Once upon a time, there
  5. story 3.26
    <|bos|>Once upon a time, there
  6. story 3.26
    <|bos|>Once upon a time, there
  7. story 3.26
    <|bos|>Once upon a time, there
  8. story 3.26
    <|bos|>Once upon a time, there
  9. story 3.26
    <|bos|>Once upon a time, in
  10. story 3.26
    <|bos|>Once upon a time, there
  11. story 3.18
    to show everyone back home!<|bos|>Once upon a time, in
  12. story 3.16
    <|assistant_end|><|bos|>Once upon a time, there