Skip to content
mini-lab
Features of prelude-2

Feature #621

Fires on “ for” (not labeled yet: read the examples)

Fires on
0.28% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 54%
  • python 25%
  • chat 13%
  • agent 5%
  • worksheet 4%

Makes the model say

their import=?"." jo<|tool_call_end|>path

Makes it not say

newallndum excited buteres

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 3.96
    of fun.<|assistant_end|><|bos|>One day, a cat named Jazz went for a walk. J
  2. story 3.92
    project.<|assistant_end|><|bos|>One day, a mighty big cat named Tom went for a walk. He
  3. story 3.9
    day, a big dog named Max went for a walk with his
  4. story 3.8
    3.<|bos|>One day, a big, honest dog named Max went for a walk. He
  5. story 3.77
    jungle.<|bos|>One day, a big, thick cat named Tom went for a walk. He
  6. story 3.73
    <|bos|>One day, a boy named Tom and his old dog Spot went for a walk in the
  7. story 3.7
    9.<|assistant_end|><|bos|>One day, a small dog named Max went for a walk on a
  8. story 3.7
    49.<|assistant_end|><|bos|>One day, a dog named Max went for a jog in
  9. story 3.69
    to add?<|assistant_end|><|bos|>One day, a friendly cat named Tom went for a walk. He
  10. story 3.68
    .py`.<|assistant_end|><|bos|>One day, a small dog named Tim went for a walk. He
  11. story 3.67
    05.<|assistant_end|><|bos|>One day, a cool cat named Sam went for a walk. He
  12. story 3.65
    4⏎[]⏎<|bos|>One day, a little dog named Tim went for a walk. He