Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #3619

Fires on “ to” (not labeled yet: read the examples)

Fires on
0.38% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 80%
  • chat 17%
  • python 2%
  • agent 1%
  • worksheet 0%

Makes the model say

Once play a promised7 the visit friend

Makes it not say

right<|assistant_end|>Created<|system_start|>dou wordsi False

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 5.64
    .<|assistant_end|><|bos|>One day, a young boy named Tim went to the store with his
  2. story 5.54
    -lab.<|assistant_end|><|bos|>One day, a little boy named Tim went to the park with his
  3. story 5.54
    843.<|assistant_end|><|bos|>One day, a boy named Tim went to the big stad
  4. story 5.49
    53.<|assistant_end|><|bos|>One day, a little girl named Mia went to the kitchen. She
  5. story 5.45
    82.<|bos|>One day, a little girl named Sue went to the park. She
  6. story 5.43
    like Lily's mom.<|bos|>One day, a boy named Tim went to play outside. He
  7. story 5.43
    began to set.<|bos|>One day, a little girl named Sue went to the park. She
  8. story 5.41
    772.<|bos|>One day, a little boy named Tim went to the park with his
  9. story 5.39
    a story!<|assistant_end|><|bos|>One day, a little boy named Tim went to a big, scary
  10. chat 5.38
    !<|user_end|><|assistant_start|>Sure! One day, a little boy named Tim went to the beach. He
  11. story 5.37
    True⏎```<|assistant_end|><|bos|>One day, a little girl named Sue went to her classroom.
  12. story 5.36
    urther danger.<|bos|>One day, a little girl named Amy went to the park. She