Skip to content
mini-lab
Features of prelude-2

Feature #4065

Fires on “,” (not labeled yet: read the examples)

Fires on
0.74% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 76%
  • chat 18%
  • agent 3%
  • python 2%
  • worksheet 0%

Makes the model say

a projecttnums theopencode voice man

Makes it not say

estNoBe!veredLook sheo

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 3.97
    <|bos|>One day, a little ball named
  2. story 3.69
    `items.py`, line 1.<|assistant_end|><|bos|>One sunny day, a little girl named
  3. story 3.68
    Now Lucy has 11626 toys.<|bos|>One day, a smart girl named
  4. story 3.63
    Lucy for making it look so pretty.<|bos|>One day, a little cat named
  5. story 3.61
    they found the big, shiny balloon in the tree.<|bos|>One day, a little boy named
  6. story 3.6
    82347 apples.<|bos|>One day, a little girl named
  7. story 3.58
    + 73 = 82.<|bos|>One day, a little girl named
  8. story 3.58
    Hi! How can I help with your code?<|assistant_end|><|bos|>One day, Tim and his mom
  9. story 3.57
    843.<|assistant_end|><|bos|>One day, a boy named Tim
  10. story 3.54
    Hi! What should we do in this project?<|assistant_end|><|bos|>One day, a group of ants
  11. story 3.53
    to be more careful with his toy weapon.<|bos|>One day, a cat named B
  12. story 3.49
    like a story, or some numbers to add?<|assistant_end|><|bos|>One day, a strong boy named