Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #3386

Fires on “Once” (not labeled yet: read the examples)

Fires on
0.59% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 36%
  • agent 31%
  • chat 27%
  • python 6%
  • worksheet 1%

Makes the model say

And foren, hello until inHi

Makes it not say

max numsmax3RenameAddedMax files

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 3.27
    with `final_letter(s)`.<|assistant_end|><|bos|>Once upon a time,
  2. story 3.27
    <|assistant_end|><|bos|>Once upon a time,
  3. story 3.24
    py`.<|assistant_end|><|bos|>Once upon a time,
  4. chat 3.23
    <|assistant_end|><|user_start|>can you tell me a story about a dragon<|user_end|><|assistant_start|>Once upon a time,
  5. chat 3.2
    cubed<|assistant_end|><|bos|><|user_start|>Write a short story about a tree.<|user_end|><|assistant_start|>Once upon a time,
  6. story 3.17
    hi.py`.<|assistant_end|><|bos|>Once upon a time,
  7. story 3.14
    is 70.<|assistant_end|><|bos|>Once upon a time,
  8. chat 3.12
    0.<|assistant_end|><|bos|><|user_start|>Can you tell me a story?<|user_end|><|assistant_start|>Once upon a time,
  9. story 3.12
    <|bos|>Once upon a time,
  10. story 3.12
    <|bos|>Once upon a time,
  11. story 3.12
    <|bos|>Once upon a time,
  12. story 3.12
    <|bos|>Once upon a time,