Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #1131

Fires on “,” (not labeled yet: read the examples)

Fires on
0.43% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 54%
  • agent 22%
  • chat 20%
  • worksheet 2%
  • python 2%

Makes the model say

there lived can bigger walked mean sayan

Makes it not say

to coursefeingLucy<|arg|>head item

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 3.36
    was happy again.<|bos|>Once upon a time, in a small town, there was a little
  2. story 3.29
    the nice day.<|bos|>Once upon a time, in a small town, there lived a little
  3. story 3.22
    happily ever after.<|bos|>Once upon a time, in a small town, there was a tall
  4. chat 3.21
    a tree?<|user_end|><|assistant_start|>Once upon a time, in a small town, there was a mighty
  5. story 3.2
    0⏎```<|assistant_end|><|bos|>Once upon a time, in a small town, there was a red
  6. story 3.17
    add numbers.<|assistant_end|><|bos|>Once upon a time, in a small town, there lived a cute
  7. story 3.14
    back to bed.<|bos|>Once upon a time, in a small town, there was a girl
  8. story 3.12
    608.<|bos|>Once upon a time, in a small town, there was a mot
  9. story 3.08
    lots of fun.<|bos|>Once upon a time, in a small town, there was a dependable
  10. story 3.07
    74.<|assistant_end|><|bos|>Once upon a time, in a small town, there was a big
  11. story 3.07
    you today?<|assistant_end|><|bos|>Once upon a time, in a small town, there was a big
  12. story 3.06
    wards for trying.<|bos|>Once upon a time, in a small town, there lived a boy