Skip to content
mini-lab
Features of prelude-2

Feature #888

Fires on “ boy” (not labeled yet: read the examples)

Fires on
0.40% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 64%
  • agent 17%
  • chat 14%
  • python 4%
  • worksheet 2%

Makes the model say

ourRename definedaeiou lenopencode nums divisible

Makes it not say

with thereillamC she shared

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 4.72
    .py`.<|assistant_end|><|bos|>Once upon a time, there was a little boy named Tim. Tim
  2. story 4.71
    22.<|assistant_end|><|bos|>Once upon a time, there was a little boy named Tom. He
  3. chat 4.64
    <|user_end|><|assistant_start|>Sure! Once upon a time, there was a little boy named Tim. Tim
  4. story 4.62
    4⏎```<|assistant_end|><|bos|>Once upon a time, there was a little boy named John who lived
  5. story 4.59
    .py`.<|assistant_end|><|bos|>Once upon a time, there was a little boy named Tim. Tim
  6. chat 4.59
    short story.<|user_end|><|assistant_start|>Once upon a time, there was a little boy named Tim.
  7. story 4.59
    799.<|bos|>Once upon a time, there was a little boy named Tim. He
  8. story 4.57
    add numbers.<|assistant_end|><|bos|>Once upon a time, there was a little boy named Tim. Tim
  9. story 4.56
    .py`.<|assistant_end|><|bos|>Once upon a time, there was a little boy named Tom. Tom
  10. story 4.55
    .py`.<|assistant_end|><|bos|>Once upon a time, there was a little boy named Tim. He
  11. story 4.54
    116.<|bos|>Once upon a time, there was a little boy called David
  12. story 4.52
    was still amazing.<|bos|>Once upon a time, there was a little boy named Tim. Tim