Features of prelude-2
Inside the model, every token is a list of numbers that mix many things at once. A sparse autoencoder, trained on the residual stream after block 4, splits it into 4,096 directions, few of them active at a time: each one tends to mean one thing, like “the last digit of a number” or “a story begins”. Shaded tokens show where a feature fires.
- Features
- 4,096
- Loss recovered
- 98.9%
- Variance unexplained
- 7.3%
- Model loss, with the features
- 2.565 → 2.631
4,096 features.
-
#2646
Fires on “ day”python 1.10% of tokensmom and dad talk to each other. From that day on,
-
#2647
Fires on “ a”story 0.51% of tokensa monkey and a dog.
-
#2648
Fires on “ the”agent 0.65% of tokens<|system_start|>You are a helpful assistant.<|system_end|><|user_start|>Find the sum of
-
#2649
Fires on “I”chat 0.25% of tokensnumbers.<|assistant_end|><|user_start|>Who are you?<|user_end|><|assistant_start|>I'm prelude
-
#2650
Fires on “3”worksheet 0.78% of tokens64 more. Now Tim has 5962 stars
-
#2651
Fires on “ only”agent 0.37% of tokenswith the number only.<|system_end|>
-
#2652
Fires on “c”chat 0.46% of tokenscute<|system_end|>
-
#2653
Fires on “ had”story 0.44% of tokensJane made the most beautiful paper airplane she had ever seen
-
#2654
Fires on “ were”story 0.50% of tokensed to the garden.⏎The moral of this
-
#2655
Fires on “ Now”story 0.73% of tokensNow Lucy has
-
#2656
Fires on “ does”worksheet 0.50% of tokensgets 39 more apples. How many apples does Tom have
-
#2657
Fires on “ so”agent 0.34% of tokensgave Daisy a pedal bike. Daisy was so happy and
-
#2658
Fires on “4”worksheet 0.47% of tokens4961 + 28554 =
-
#2659
Fires on “("”agent 0.41% of tokens⏎from lib import hello⏎⏎print(hello("Eva
-
#2660
Fires on “ by”agent 0.69% of tokensawe.
-
#2661
Fires on “1”worksheet 1.11% of tokens7+03: 7+3=10,
-
#2662
Fires on “path”story 1.09% of tokenshappily nodded and
-
#2663
Fires on “#”story 0.39% of tokensin nums]⏎⏎# README.md⏎# Sc
-
#2664
Fires on “<|user_start|>”agent 0.41% of tokensrunning in OpenCode, a coding agent harness.<|system_end|><|user_start|>Change
-
#2665
Fires on “ And”story 0.25% of tokenstogether and helping each other can solve problems. And from that
-
#2666
Fires on “ always”story 0.44% of tokenstoy safe. And from that day on, Lily always made sure
-
#2667
Fires on “ s”story 0.47% of tokensball. The ball had a symb
-
#2668
Fires on “,”worksheet 3.07% of tokens⏎assert has_item([5, 0, 6
-
#2669
Fires on “ I”story 0.48% of tokens"I want to go to a party, but I don't
-
#2670
Fires on “c”agent 0.80% of tokensto have a lot of fun. They were very thoughtful and
-
#2671
Fires on “main”agent 0.22% of tokens=square<|tool_call_end|><|assistant_end|><|tool_start|>Found 6 matches⏎main.py
-
#2672
Fires on “ so”story 0.69% of tokensdecided to join the rabbit on its journey so they both
-
#2673
Fires on “ How”worksheet 0.42% of tokens. Mia gets 177 more flowers. How many flowers
-
#2674
Fires on “ a”story 0.53% of tokensthe kitchen with her mom. Her mom wore an apron
-
#2675
Fires on “ main”agent 0.56% of tokens<|assistant_start|><|tool_call_start|>shell<|arg|>command=python3 main.py
-
#2676
Fires on “⏎”python 0.78% of tokensmom said, "Yes, you can, but be careful."
-
#2677
Fires on “⏎”story 1.41% of tokens. Do you want to play with my ball?"⏎The dog
-
#2678
Fires on “ They”story 0.62% of tokensI am Danny. I like bricks. They are fun
-
#2679
Fires on “ "”agent 0.69% of tokenshim to reach.⏎Tim asked his mom, "Can you
-
#2680
Fires on “ flowers”agent 0.32% of tokens757⏎Anna had 263 flowers and found
-
#2681
Fires on “1”worksheet 0.25% of tokens2⏎4575+0002:
-
#2682
Fires on “p”worksheet 0.54% of tokens+0=3, 35269⏎So
-
#2683
Fires on “ apples”story 0.37% of tokens1377⏎Ben had 41 apples and found
-
#2684
Fires on “ day”story 1.24% of tokensnamed Tim. He loved to run and play all day. Tim
-
#2685
Fires on “ the”worksheet 0.16% of tokens5 = 326.⏎Find the sum of
-
#2686
Fires on “ candy”story 0.71% of tokensthere was a little boy named Tim. He loved candy so much
-
#2687
Fires on “ so”story 0.16% of tokensin the grass. They had so much fun
-
#2688
Fires on “,”agent 1.62% of tokensecute, gith
-
#2689
Fires on “ sad”story 0.90% of tokens.⏎The sunglasses broke into pieces. Tim was sad because his
-
#2690
Fires on “0”worksheet 0.64% of tokens+57: 3+7=10,
-
#2691
Fires on “G”story 2.10% of tokensstarted to argue and shout.⏎"Give it
-
#2692
Fires on “ with”story 0.64% of tokensday. He would wag his tail and bark with joy when
-
#2693
Fires on “1”python 0.50% of tokens5, 8, 8])⏎[14,
-
#2694
Fires on “ everyone”agent 0.52% of tokensknife and put it in her bag to keep everyone safe.
-
#2695
Fires on “ tried”agent 0.32% of tokenswas very loud and it made Tim cry. They tried to drive