Features of prelude-2
Inside the model, every token is a list of numbers that mix many things at once. A sparse autoencoder, trained on the residual stream after block 4, splits it into 4,096 directions, few of them active at a time: each one tends to mean one thing, like “the last digit of a number” or “a story begins”. Shaded tokens show where a feature fires.
- Features
- 4,096
- Loss recovered
- 98.9%
- Variance unexplained
- 7.3%
- Model loss, with the features
- 2.565 → 2.631
4,096 features.
-
#3148
Fires on “ upon”story 0.41% of tokenstell short stories and add numbers.<|assistant_end|><|bos|>Once upon a time
-
#3149
Fires on “ Do”story 0.26% of tokens, "Tom, I have a special rock. Do you want
-
#3150
Fires on “<|assistant_start|>”agent 0.78% of tokens⏎2: return a + b<|tool_end|><|assistant_start|><|tool_call_start|>ed
-
#3151
Fires on “1”agent 0.62% of tokens<|assistant_end|><|tool_start|>Read file run.py, lines 1-7
-
#3152
Fires on “:”agent 1.61% of tokensyourself," Mommy says.⏎"Sorry, Mommy, we didn
-
#3153
Fires on “ know”chat 0.16% of tokens, I can't help with that. I only know how to
-
#3154
Fires on “ saw”story 1.09% of tokensand started to play with Buddy. Buddy's friends saw how kind
-
#3155
Fires on “em”agent 0.70% of tokens.⏎The man stopped, looking around in amazement.
-
#3156
Fires on “1”worksheet 0.69% of tokens5+42: 5+2+1=8
-
#3157
Fires on “1”agent 0.82% of tokens⏎7+6: 7+6=13,
-
#3158
Fires on “ have”story 0.70% of tokensgirls," their mom said. "But you have to be
-
#3159
Fires on “ return”python 1.44% of tokens, b):⏎ if a > b:⏎ return a⏎
-
#3160
Fires on “ bird”story 1.79% of tokens, there was a unique little bird named Tim
-
#3161
Fires on “_”agent 0.27% of tokens("robot") == "r"⏎assert first_letter("
-
#3162
Fires on “_”agent 0.72% of tokenstheir gray dog, Max. They like to play hide and seek
-
#3163
Fires on “ who”story 0.52% of tokensthe cow had a race. They wanted to see who was the
-
#3164
Fires on “aeiou”agent 0.25% of tokensMr. W
-
#3165
Fires on “7”worksheet 1.37% of tokens⏎481+927:
-
#3166
Fires on “ and”story 3.21% of tokensIt was Sue's toy! Sue was so happy and said,
-
#3167
Fires on “,”story 3.01% of tokenslike to play with cars and trucks. One day, they find
-
#3168
Fires on “In”agent 1.12% of tokensin OpenCode, a coding agent harness.<|system_end|><|user_start|>In tools.
-
#3169
Fires on “ at”story 0.50% of tokensa young boy named Tim went to the store with his mom.
-
#3170
Fires on “py”agent 0.66% of tokens([1, 0, 2])` returns `3`.
-
#3171
Fires on “ill”story 1.08% of tokens, little rabbit named Ralph.
-
#3172
Fires on “ ever”agent 0.92% of tokensclimbed to the
-
#3173
Fires on “x”agent 2.15% of tokens(x):⏎
-
#3174
Fires on “3”story 0.32% of tokensconfig.json"⏎}⏎⏎$ python3 test_
-
#3175
Fires on “ to”agent 1.17% of tokens61.<|assistant_end|><|user_start|>Now add 12 to the result
-
#3176
Fires on “_”story 0.74% of tokens_halve<|arg|>
-
#3177
Fires on “ right”agent 0.17% of tokenseverything around them
-
#3178
Fires on “ tiny”chat 0.24% of tokensname?<|user_end|><|assistant_start|>I'm prelude, a very small language model
-
#3179
Fires on “all”agent 0.40% of tokenspython3 test_core.py<|tool_call_end|><|assistant_end|><|tool_start|>all tests passed
-
#3180
Fires on “ a”chat 0.70% of tokens<|user_start|>Can you tell me a story about
-
#3181
Fires on “ heard”story 0.21% of tokenstrouble.⏎As he was walking, he suddenly heard a loud
-
#3182
Fires on “?”story 0.55% of tokens?<|user_end|><|assistant_start|>
-
#3183
Fires on “ went”story 0.23% of tokens. Max was very happy.⏎When the sun went down,
-
#3184
Fires on “ stuck”agent 0.30% of tokensthe butterfly was flying, it saw a small bug stuck in a
-
#3185
Fires on “M”story 0.43% of tokenspick it up and take a bite.⏎"Mmm
-
#3186
Fires on “py”agent 0.76% of tokensshell<|arg|>command=python3 hello.py<|tool_call_end|><|assistant_end|>
-
#3187
Fires on “ How”worksheet 0.49% of tokens1 more coins. How many coins
-
#3188
Fires on “ thought”story 0.55% of tokensSo, she thought of a
-
#3189
Fires on “#”story 0.36% of tokens48.<|assistant_end|><|bos|># README.md⏎# Tool
-
#3190
Fires on “Thank”agent 0.40% of tokenspicked the pear for Tim. Tim said, "Thank you!"
-
#3191
Fires on “'t”story 1.21% of tokens. Don't be sad
-
#3192
Fires on “ on”story 0.27% of tokensOne day, she saw a big, red envelope on the floor
-
#3193
Fires on “,”agent 0.77% of tokensNUMBERS = [6, 0, 0, 8
-
#3195
Fires on “ his”story 0.91% of tokensshe did not know how.⏎Mia went to her mom and
-
#3196
Fires on “ thought”agent 0.29% of tokensfly. Poppy wanted to help the bug. She thought she could
-
#3197
Fires on “Hello”chat 1.16% of tokensHello!"<|user_end|>
-
#3198
Fires on “ lists”story 0.95% of tokens, lines 1-3⏎1: from lists import min