Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #2527

Fires on “ two” (not labeled yet: read the examples)

Fires on
0.32% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 64%
  • chat 16%
  • agent 13%
  • python 6%
  • worksheet 2%

Makes the model say

friends: best == named called set big

Makes it not say

moment squared In<|assistant_end|> knowsdef "!" power

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 9.9
    the snow all day.<|bos|>Once upon a time, there were two friends called Ant
  2. story 9.72
    big smiles on their faces.<|bos|>Once upon a time, there were two animals, a dog
  3. story 9.63
    .<|assistant_end|><|bos|>Once upon a time there were two children, Joe and
  4. story 9.61
    planning a big meal.<|bos|>Once upon a time, there were two friends, John and
  5. story 9.54
    stories and add numbers.<|assistant_end|><|bos|>Once upon a time, there were two friends called Drew
  6. story 9.5
    514 flowers.<|bos|>Once upon a time, there were two little girls playing
  7. story 9.45
    win the race. The end.<|bos|>Once upon a time there were two friends, Sam and
  8. story 9.36
    iture to play on.<|bos|>Once upon a time, there were two friends, Pet
  9. story 9.32
    he could do anything he wanted!<|bos|>Once upon a time there were two best friends, Peter
  10. story 9.28
    The tests pass now.<|assistant_end|><|bos|>Once upon a time, there were two best friends: Bob
  11. story 9.26
    tasty on that gloomy day.<|bos|>Once upon a time, there were two friends named Bob and
  12. story 9.21
    and `arith.py`.<|assistant_end|><|bos|>Once upon a time there were two friends, Jack and