Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #375

Fires on “ in” (not labeled yet: read the examples)

Fires on
0.38% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 49%
  • story 35%
  • chat 14%
  • python 2%
  • worksheet 0%

Makes the model say

utils got forever little nowim how river

Makes it not say

( `," everywhereRun+ asking))

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 3.57
    Once upon a time, in a big sky,
  2. story 3.56
    <|bos|>Once upon a time, in a big garden,
  3. story 3.5
    495<|assistant_end|><|bos|>Once upon a time, in a small house near
  4. story 3.41
    ing colors and playing together.<|bos|>Once upon a time, in a big forest,
  5. story 3.4
    to show everyone back home!<|bos|>Once upon a time, in a small village,
  6. story 3.38
    upon a time, in a big forest,
  7. story 3.35
    enjoyed the rest of the nice day.<|bos|>Once upon a time, in a small town,
  8. chat 3.31
    <|user_end|><|assistant_start|>Once upon a time, in a cheerful forest
  9. story 3.3
    tell short stories and add numbers.<|assistant_end|><|bos|>Once upon a time, in a small town,
  10. story 3.28
    The answer is 13.<|assistant_end|><|bos|>Once upon a time, in a bright, sunny
  11. story 3.26
    9 = 10087<|bos|>Once upon a time, in a big forest,
  12. story 3.25
    . And they played happily ever after.<|bos|>Once upon a time, in a small town,