Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #60

Fires on “,” (not labeled yet: read the examples)

Fires on
1.83% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 48%
  • agent 42%
  • chat 6%
  • python 3%
  • worksheet 1%

Makes the model say

but and little because too so even not

Makes it not say

<|think_start|><|assistant_end|> nums<|tool_call_end|>Max functions]`newString

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 5.57
    ice to meet you, Tim."⏎Tim
  2. story 5.54
    day and had lots of fun. Tim learned that waiting can be hard, but it can be
  3. story 5.49
    a rainbow scarf from you. You are very sweet and creative, Sara. You make
  4. story 5.44
    't be sad, oven. You may not march like the ants, but you can help
  5. story 5.14
    are you sad, bird?" The bird
  6. story 5.1
    to be home. He learned that it's fun to try new things, but it's also
  7. story 5.05
    too and she loves him. She says he is still a good boy, but he needs
  8. story 4.98
    The moral of the story is, do not do bad things to others, or bad things may
  9. story 4.94
    ny. The crab said, "I want to go to a party, but I don't
  10. story 4.91
    to Lily's house, and they went to
  11. story 4.86
    played together with it all day. They learned that sharing can be fun, even if it's
  12. story 4.82
    to play with something else. They learned that soap bubbles can be fun, but also dangerous.