Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #3802

Fires on “ time” (not labeled yet: read the examples)

Fires on
0.43% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 78%
  • chat 21%
  • agent 1%
  • python 0%
  • worksheet 0%

Makes the model say

there, me W sky G grass⏎

Makes it not say

files PythonSam moral brother even<|think_end|> matter

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 6.3
    61799.<|bos|>Once upon a time, there was a
  2. story 6.29
    quarrel anymore, and they were happy.<|bos|>Once upon a time, there was an
  3. story 6.28
    together.<|bos|>Once upon a time there was a gray
  4. story 6.27
    ing colors and playing together.<|bos|>Once upon a time, in a big
  5. story 6.14
    the snow all day.<|bos|>Once upon a time, there were two
  6. story 6.13
    py`.<|assistant_end|><|bos|>Once upon a time, there was a
  7. story 6.12
    check the diary before planning a big meal.<|bos|>Once upon a time, there were two
  8. story 6.11
    <|bos|>Once upon a time, there was a
  9. story 6.11
    <|bos|>Once upon a time, there was a
  10. story 6.11
    <|bos|>Once upon a time, there was a
  11. story 6.11
    <|bos|>Once upon a time, there was a
  12. story 6.11
    <|bos|>Once upon a time, in a big