Skip to content
mini-lab
Features of prelude-2

Feature #1143

Fires on “Once” (not labeled yet: read the examples)

Fires on
0.62% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 64%
  • chat 29%
  • agent 4%
  • python 2%
  • worksheet 0%

Makes the model say

Once upon Spot to Tomteneties

Makes it not say

Thank who happy angry faceS<|arg|> friend

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 4.02
    <|bos|>Once upon a time,
  2. story 4.02
    <|bos|>Once upon a time,
  3. story 4.02
    <|bos|>Once upon a time,
  4. story 4.02
    <|bos|>Once upon a time,
  5. story 4.02
    <|bos|>Once upon a time,
  6. story 4.02
    <|bos|>Once upon a time,
  7. story 3.99
    <|assistant_end|><|bos|>Once upon a time,
  8. story 3.98
    the snow all day.<|bos|>Once upon a time,
  9. story 3.94
    py`.<|assistant_end|><|bos|>Once upon a time,
  10. story 3.94
    0.<|assistant_end|><|bos|>Once upon a time,
  11. story 3.93
    old lady was happy.<|bos|>Once upon a time,
  12. story 3.9
    Sam was a little boy.<|assistant_end|><|bos|>Once upon a time,