Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #571

Fires on “ two” (not labeled yet: read the examples)

Fires on
0.08% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 45%
  • story 43%
  • chat 8%
  • python 2%
  • worksheet 1%

Makes the model say

Thank way⏎ exclaim more though moralowed

Makes it not say

it) plus named funny can+ seek

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 1.85
    big smiles on their faces.<|bos|>Once upon a time, there were two animals, a dog
  2. story 1.77
    and `arith.py`.<|assistant_end|><|bos|>Once upon a time there were two friends, Jack and
  3. story 1.72
    514 flowers.<|bos|>Once upon a time, there were two little girls playing
  4. story 1.71
    win the race. The end.<|bos|>Once upon a time there were two friends, Sam and
  5. story 1.69
    upon a time there were two shapes. One was
  6. story 1.68
    tasty on that gloomy day.<|bos|>Once upon a time, there were two friends named Bob and
  7. story 1.68
    mean(a, b)`.<|assistant_end|><|bos|>Once upon a time there were two brave friends, H
  8. story 1.67
    the snow all day.<|bos|>Once upon a time, there were two friends called Ant
  9. story 1.67
    he could do anything he wanted!<|bos|>Once upon a time there were two best friends, Peter
  10. story 1.66
    `app.py`.<|assistant_end|><|bos|>Once upon a time, there were two
  11. story 1.65
    passes: all tests passed.<|assistant_end|><|bos|>Once upon a time there were two friends, Steven
  12. story 1.64
    planning a big meal.<|bos|>Once upon a time, there were two friends, John and