Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #945

Fires on “ time” (not labeled yet: read the examples)

Fires on
1.98% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 38%
  • story 24%
  • chat 21%
  • worksheet 9%
  • python 9%

Makes the model say

<|assistant_end|> calculator`,oldString<|assistant_start|> adds<|user_end|>newString

Makes it not say

3 they5 h They2 other c

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 2.9
    old lady was happy.<|bos|>Once upon a time, there was a
  2. story 2.87
    and add numbers.<|assistant_end|><|bos|>Once upon a time, there was a
  3. story 2.85
    stories and add numbers.<|assistant_end|><|bos|>Once upon a time, there was a
  4. story 2.83
    is 70.<|assistant_end|><|bos|>Once upon a time, there was a
  5. story 2.8
    =3, 39<|think_end|>39<|assistant_end|><|bos|>Once upon a time, there was a
  6. story 2.79
    61799.<|bos|>Once upon a time, there was a
  7. story 2.78
    .<|assistant_end|><|bos|>Once upon a time there were two children
  8. story 2.78
    .<|assistant_end|><|bos|>Once upon a time, there was a
  9. chat 2.78
    Once upon a time, there was a
  10. story 2.78
    Once upon a time, there was a
  11. story 2.78
    Once upon a time, in a big
  12. story 2.76
    can only tell short stories and add numbers.<|assistant_end|><|bos|>Once upon a time a very ancient flag