Skip to content
mini-lab
Features of prelude-2

Feature #1240

Fires on “ can” (not labeled yet: read the examples)

Fires on
1.45% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 39%
  • worksheet 33%
  • chat 16%
  • python 8%
  • agent 4%

Makes the model say

high( return5 monkey frogH stuck

Makes it not say

>CreateWhat<|bos|>moduleEdited<|think_start|>Fixed

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 1.79
    !".<|system_end|><|user_start|>hey there<|user_end|><|assistant_start|>Sure! Hello! How can I help you today
  2. story 1.78
    day, the puppy saw a book on the floor. He had never seen anything like it before
  3. story 1.77
    he needed a fork. He asked his mom, "Please, can I have a for
  4. story 1.73
    dirty. Tim felt sad.⏎Tim asked his mom, "How can I make my mic
  5. agent 1.72
    : all tests passed.<|assistant_end|><|user_start|>hey<|user_end|><|assistant_start|>Hello! How can I help with your
  6. chat 1.67
    is 2.<|assistant_end|><|user_start|>Good morning!<|user_end|><|assistant_start|>Hello! How can I help you today
  7. chat 1.66
    her mom and dad.<|assistant_end|><|user_start|>Hello!<|user_end|><|assistant_start|>Hello! How can I help you today
  8. story 1.66
    .⏎Tim went to his mom and asked, "Mom, where did the new ball come
  9. chat 1.65
    "Sure!".<|system_end|><|user_start|>Hi<|user_end|><|assistant_start|>Sure! Hello! How can I help you today
  10. chat 1.65
    and the birds were singing.<|assistant_end|><|user_start|>Hey<|user_end|><|assistant_start|>Hello! How can I help you today
  11. story 1.65
    , but it was too hard.⏎The girl asked, "How can I unlock the door
  12. chat 1.64
    so he went to his dad for help.⏎"Dad, how do we fix the le