Skip to content
mini-lab
Features of prelude-2

Feature #2947

Fires on “Once” (not labeled yet: read the examples)

Fires on
0.24% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 70%
  • chat 26%
  • agent 2%
  • python 1%
  • worksheet 1%

Makes the model say

theresOnce shehalg import agreed

Makes it not say

)`Rhead$ giftread Autils

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 4.98
    ```⏎<|bos|><|user_start|>Tell me a story about a bird.<|user_end|><|assistant_start|>Once upon a time,
  2. story 4.97
    stats.py` with `keep_even(nums)`.<|assistant_end|><|bos|>Once upon a time there
  3. story 4.91
    py`.<|assistant_end|><|bos|>Once upon a time,
  4. chat 4.86
    ```⏎<|bos|><|user_start|>I want a story about a tree!<|user_end|><|assistant_start|>Once upon a time,
  5. chat 4.86
    96.<|assistant_end|><|bos|><|user_start|>Once upon a time...<|user_end|><|assistant_start|>Once upon a time there
  6. story 4.85
    =10, 105<|think_end|>105<|assistant_end|><|bos|>Once upon a time,
  7. chat 4.84
    .<|assistant_end|><|bos|><|user_start|>Tell me a story about a fish.<|user_end|><|assistant_start|>Once upon a time,
  8. chat 4.83
    : calculator<|system_end|><|user_start|>Tell me a story about a dragon.<|user_end|><|assistant_start|>Once upon a time,
  9. story 4.83
    Created `utils.py` with `largest(nums)`.<|assistant_end|><|bos|>Once upon a time,
  10. chat 4.83
    cubed<|assistant_end|><|bos|><|user_start|>Write a short story about a tree.<|user_end|><|assistant_start|>Once upon a time,
  11. story 4.81
    hi.py`.<|assistant_end|><|bos|>Once upon a time,
  12. chat 4.79
    9<|assistant_end|><|bos|><|user_start|>I want a story about a fish!<|user_end|><|assistant_start|>Once upon a time,