Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #1156

Fires on “Once” (not labeled yet: read the examples)

Fires on
0.41% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 51%
  • python 15%
  • chat 15%
  • worksheet 12%
  • agent 7%

Makes the model say

(<|tool_call_end|> exclamation seen outside picked know<|user_end|>

Makes it not say

heving no.ful herselfmanyx

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 3.24
    py`.<|assistant_end|><|bos|>Once upon a time,
  2. story 3.2
    stats.py` with `keep_even(nums)`.<|assistant_end|><|bos|>Once upon a time there
  3. story 3.17
    defined in `text.py`, line 1.<|assistant_end|><|bos|>Once upon a time,
  4. story 3.12
    hi.py`.<|assistant_end|><|bos|>Once upon a time,
  5. story 3.1
    1382<|bos|>Once upon a time,
  6. story 3.09
    =10, 105<|think_end|>105<|assistant_end|><|bos|>Once upon a time,
  7. story 3.08
    ```<|assistant_end|><|bos|>Once upon a time,
  8. story 3.05
    is 70.<|assistant_end|><|bos|>Once upon a time,
  9. story 3.04
    61799.<|bos|>Once upon a time,
  10. story 3.03
    model: I can only tell short stories and add numbers.<|assistant_end|><|bos|>Once upon a time a
  11. story 3.01
    Created `utils.py` with `largest(nums)`.<|assistant_end|><|bos|>Once upon a time,
  12. story 3.01
    with `final_letter(s)`.<|assistant_end|><|bos|>Once upon a time,