Features of prelude-2
Inside the model, every token is a list of numbers that mix many things at once. A sparse autoencoder, trained on the residual stream after block 4, splits it into 4,096 directions, few of them active at a time: each one tends to mean one thing, like “the last digit of a number” or “a story begins”. Shaded tokens show where a feature fires.
- Features
- 4,096
- Loss recovered
- 98.9%
- Variance unexplained
- 7.3%
- Model loss, with the features
- 2.565 → 2.631
4,096 features.
-
#1194
Fires on “ with”python 0.34% of tokens⏎Fix: replace `return min(nums)` with `return
-
#1195
Fires on “ b”story 0.19% of tokensb:⏎
-
#1196
Fires on “ of”story 0.21% of tokensan idea! He went to the little boy and offered
-
#1197
Fires on “!”story 0.40% of tokenstruck and said, "Hi, friend! Can we
-
#1198
Fires on “ no”story 0.38% of tokenswith her vest and her dad followed her, no longer lean
-
#1199
Fires on “ His”agent 1.08% of tokens, "Can you help me get the cone?" His mom tried
-
#1200
Fires on “ have”story 1.21% of tokenswe can share the shell, Ben. But you have to help
-
#1201
Fires on “⏎”agent 1.00% of tokens, like the dancers she sees on TV.⏎One day
-
#1202
Fires on “6”worksheet 0.81% of tokens416 is
-
#1203
Fires on “ for”story 0.54% of tokensfor me?
-
#1204
Fires on “ does”chat 0.32% of tokens. How many flowers does Mia have
-
#1205
Fires on “⏎”worksheet 0.27% of tokens⏎9 plus 2 equals 11.⏎61
-
#1206
Fires on “1”worksheet 0.21% of tokens3: 7+3+1=1
-
#1207
Fires on “ ”agent 0.26% of tokenstest_text.py<|tool_end|><|assistant_start|>This project has 3 Python
-
#1208
Fires on “ sandwich”story 3.54% of tokensa big bird flew down and took the man's sandwich. The
-
#1209
Fires on “ he”story 0.87% of tokensBut as soon as he stepped out the door, he saw the
-
#1210
Fires on “+”worksheet 0.51% of tokens2⏎32+07: 2+7+
-
#1211
Fires on “ Python”agent 0.17% of tokensyou Fluffy. Do you
-
#1212
Fires on “ toys”chat 0.69% of tokens. Sue gets 5 more toys. How many toys does Sue
-
#1213
Fires on “<|tool_call_end|>”agent 3.44% of tokens<|tool_call_start|>calculator<|arg|>expression=5 + 20<|tool_call_end|><|assistant_end|><|tool_start|>
-
#1214
Fires on “,”agent 0.52% of tokensure. She danced on the chair, the table, and even
-
#1215
Fires on “⏎”worksheet 0.62% of tokens+ 63 = 917.⏎What is
-
#1216
Fires on “,”chat 0.68% of tokens<|bos|>One day, a little
-
#1217
Fires on “ the”story 0.59% of tokenswere happy and full. Max and his friends spent the night sleep
-
#1218
Fires on “'s”story 0.81% of tokenssaid to her: "Millie, it's time to
-
#1219
Fires on “ only”chat 0.16% of tokensbecame good friends.<|bos|><|system_start|>Answer with the number only.<|system_end|>
-
#1220
Fires on “<|assistant_start|>”agent 0.92% of tokensue<|tool_call_end|><|assistant_end|><|tool_start|>Edited listlib.py (1 replacement)<|tool_end|>
-
#1221
Fires on “ mean”agent 0.62% of tokensaverage of nums.⏎⏎```python⏎def mean_list
-
#1222
Fires on “ said”story 0.85% of tokenswhy is this bird so angry?" Grandma laughed and said, "
-
#1223
Fires on “ his”story 0.51% of tokenshis friend,
-
#1224
Fires on “9”worksheet 0.87% of tokens1: 8+1=9, 9⏎3
-
#1225
Fires on “ and”story 0.73% of tokenswent to the kitchen and found a
-
#1226
Fires on “:”python 0.34% of tokensx):⏎ return x⏎```⏎⏎Fix: replace `
-
#1227
Fires on “ running”agent 0.42% of tokensecute<|system_end|><|system_start|>You are an AI agent running in OpenCode
-
#1228
Fires on “ "”python 0.80% of tokensreturn "Hello,
-
#1229
Fires on “ig”story 1.25% of tokensShe was playing in her room and saw a figure on
-
#1230
Fires on “<|tool_call_start|>”agent 0.32% of tokens<|assistant_start|><|tool_call_start|>she
-
#1231
Fires on “ named”story 0.38% of tokensa little boy named Tim.
-
#1232
Fires on “.”story 1.45% of tokensthen, a big bird came and heard the ant. The bird
-
#1233
Fires on “ happy”story 0.51% of tokensall had a great time. Mia was happy she made
-
#1234
Fires on “ print”agent 0.49% of tokensletter, exclaim⏎3: ⏎4: print(final
-
#1235
Fires on “ but”python 1.20% of tokens` should return the average of a and b, but it has
-
#1236
Fires on “ happy”story 0.27% of tokensand take long naps. He was a very happy cat.
-
#1237
Fires on “ `”python 0.37% of tokens`: it used `return b
-
#1238
Fires on “.”agent 1.24% of tokens_of<|tool_call_end|><|assistant_end|><|tool_start|>Found 1 matches⏎calc.py
-
#1239
Fires on “ filled”story 0.38% of tokensopened the door, she saw that the fridge was filled with har
-
#1240
Fires on “ can”story 1.45% of tokensy there<|user_end|><|assistant_start|>Sure! Hello! How can I help
-
#1241
Fires on “ helping”story 0.84% of tokensYou're welcome, Ben. I'm glad you found it.
-
#1243
Fires on “ called”story 0.77% of tokensOnce upon a time, there was a little girl called Anna.
-
#1244
Fires on “ hide”agent 0.38% of tokenstheir gray dog, Max. They like to play hide and seek