Skip to content
mini-lab
Features of prelude-2

Feature #3051

Fires on “ came” (not labeled yet: read the examples)

Fires on
0.37% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 71%
  • story 15%
  • chat 8%
  • worksheet 5%
  • python 2%

Makes the model say

Yes everythingWhatoneighed it It dad

Makes it not say

ite tryge began⏎⏎ practiced =ion

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. agent 1.47
    .<|system_end|><|user_start|>"Create mathlib.py with a function triangle that adds up the numbers from
  2. story 1.3
    sad, Bob?" Bob told Willy about the shiny rock and how he couldn't move it
  3. agent 1.27
    <|user_start|>Write a function total(nums) in lib.py that adds up all the numbers in
  4. story 1.23
    what happened?" mom asked, worried. She saw his hand and knew what he had done.
  5. story 1.21
    square box, and something unexpected happened. The box opened, and out came a lot of colorful
  6. story 1.21
    e taught his friends that it is always better to share than to keep things to yourself. The
  7. story 1.15
    Bouncy told Bunny about the hole in his house and how he had no tools to
  8. story 1.13
    .⏎But something unexpected happened. When he opened the bag, out came a magic sugar fairy
  9. story 1.12
    ying there. We should keep it safe in my closet, so nobody can lose it
  10. story 1.11
    toy box. It was shiny and red, and it had a number on it. "Look
  11. chat 1.11
    the park. The car stopped, and the door opened. Out came a big, friendly
  12. chat 1.11
    ⏎Sally went to Tom's house and said, "Tom, I have a special rock.