Skip to content
mini-lab
Features of prelude-2

Feature #629

Fires on “Once” (not labeled yet: read the examples)

Fires on
0.57% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 56%
  • chat 21%
  • agent 13%
  • python 11%
  • worksheet 0%

Makes the model say

upon there they( he<|tool_call_end|> solve in

Makes it not say

print[Abyek hurtith trust

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 4.24
    py`.<|assistant_end|><|bos|>Once upon a time,
  2. story 4.18
    stats.py` with `keep_even(nums)`.<|assistant_end|><|bos|>Once upon a time there
  3. story 4.12
    hi.py`.<|assistant_end|><|bos|>Once upon a time,
  4. story 4.09
    stats.py` with `max_item(nums)`.<|assistant_end|><|bos|>Once upon a time,
  5. story 4.02
    ```<|assistant_end|><|bos|>Once upon a time,
  6. story 4.0
    <|bos|>Once upon a time,
  7. story 4.0
    <|bos|>Once upon a time,
  8. story 4.0
    <|bos|>Once upon a time,
  9. story 4.0
    <|bos|>Once upon a time,
  10. story 4.0
    <|bos|>Once upon a time,
  11. story 4.0
    <|bos|>Once upon a time,
  12. story 3.99
    Created `utils.py` with `largest(nums)`.<|assistant_end|><|bos|>Once upon a time,