Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #1635

Fires on “Once” (not labeled yet: read the examples)

Fires on
0.92% of tokens
Mostly in
python
Layer
after block 4

Where it fires

  • python 45%
  • story 30%
  • agent 16%
  • chat 8%
  • worksheet 2%

Makes the model say

python<|tool_end|>pytest]de") NowMIT

Makes it not say

friend grass and fromen's someone2

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 4.42
    <|bos|>Once upon a time,
  2. story 4.42
    <|bos|>Once upon a time,
  3. story 4.42
    <|bos|>Once upon a time,
  4. story 4.42
    <|bos|>Once upon a time,
  5. story 4.42
    <|bos|>Once upon a time,
  6. story 4.42
    <|bos|>Once upon a time,
  7. story 4.22
    1382<|bos|>Once upon a time,
  8. story 4.18
    <|assistant_end|><|bos|>Once upon a time,
  9. story 4.16
    py`.<|assistant_end|><|bos|>Once upon a time,
  10. story 4.11
    ```<|assistant_end|><|bos|>Once upon a time,
  11. story 4.07
    25054<|bos|>Once upon a time,
  12. story 4.06
    61799.<|bos|>Once upon a time,