Skip to content
mini-lab
Features of prelude-2

Feature #2833

Fires on “ big” (not labeled yet: read the examples)

Fires on
0.04% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 48%
  • story 42%
  • chat 5%
  • worksheet 4%
  • python 1%

Makes the model say

⏎ him I`, calculator He eyes yourself

Makes it not say

# alln oddord family All every

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 1.48
    know why. He just gave a little shrug and
  2. story 1.28
    it and looked at it. She wondered what it was and where it came from. She asked
  3. story 1.16
    atch" - so that everyone who saw them would know where they came from.⏎The
  4. story 1.09
    "Your face is gone!"⏎They saw the carrot nose, the hat, and the
  5. story 1.02
    made a plan to remember the lime every day. She put a big green lime picture
  6. story 1.01
    the most wonderful things. He was a great friend and everyone loved him very much.<|bos|><|system_start|>
  7. chat 1.01
    etah. Tim was very alert and looked at each animal with big eyes.⏎Suddenly
  8. story 0.98
    being greedy and naughty. She cleaned her wound and put a bandage on it
  9. story 0.98
    hopped closer. It ate some of the food and looked at Anna with big eyes.⏎Anna
  10. story 0.97
    The doctor fixed his leg, and the big dog helped him go back through the
  11. story 0.96
    with Daisy every day. Lily was very organized. She always put Daisy back in her toy
  12. story 0.95
    ." They looked around and saw the boy hiding behind a tree. They walked to the boy and