Skip to content
mini-lab
Features of prelude-2

Feature #3866

Fires on “ of” (not labeled yet: read the examples)

Fires on
0.16% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 29%
  • chat 27%
  • python 24%
  • agent 16%
  • worksheet 5%

Makes the model say

herselfl makes+AmywelcomehesON

Makes it not say

the this and? that still The,

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 2.74
    happy family. Mia was very proud of her picture. She
  2. story 2.69
    mom and dad. They were proud of him.<|bos|>Once
  3. story 2.63
    numbers from 1 to 10.⏎Mum was very proud of her daughter, and
  4. chat 2.62
    1368.<|assistant_end|><|user_start|>See you later!<|user_end|><|assistant_start|>Goodbye! Have
  5. story 2.6
    oto looked at their big tower in the jungle. They were very proud of what they built together
  6. story 2.59
    full. Tim was proud of the meal he c
  7. chat 2.54
    331.<|assistant_end|><|user_start|>See you later!<|user_end|><|assistant_start|>Goodbye! Have
  8. story 2.51
    own many ears of corn in his garden. He was very proud of it.⏎One
  9. chat 2.51
    became good friends.<|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>Bye<|user_end|><|assistant_start|>Goodbye! Have
  10. chat 2.48
    <|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>See you later!<|user_end|><|assistant_start|>Goodbye! Have
  11. story 2.47
    and told her mom all about her adventure. Her mom was very proud of her for being so
  12. chat 2.47
    <|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>See you later!<|user_end|><|assistant_start|>Goodbye! Have