Features of prelude-2
Inside the model, every token is a list of numbers that mix many things at once. A sparse autoencoder, trained on the residual stream after block 4, splits it into 4,096 directions, few of them active at a time: each one tends to mean one thing, like “the last digit of a number” or “a story begins”. Shaded tokens show where a feature fires.
- Features
- 4,096
- Loss recovered
- 98.9%
- Variance unexplained
- 7.3%
- Model loss, with the features
- 2.565 → 2.631
4,096 features.
-
#542
Fires on “ find”story 0.52% of tokenslate. The bird was sad. It could not find its g
-
#543
Fires on “ about”chat 0.69% of tokenswhy are you
-
#544
Fires on “ for”agent 1.33% of tokenstell stories and add
-
#545
Fires on “ upon”story 0.37% of tokenspy`.<|assistant_end|><|bos|>Once upon a time
-
#546
Fires on “ years”agent 0.39% of tokenslittle girl called Millie. She was three years old and
-
#547
Fires on “ you”story 1.19% of tokensthe squirrel felt better. They both learned that when you panic
-
#548
Fires on “ project”agent 0.18% of tokensgreetings.py⏎utils.py<|tool_end|><|assistant_start|>This project has
-
#549
Fires on “#”python 0.72% of tokenspasses: all tests passed.<|assistant_end|><|bos|># lib.
-
#550
Fires on “ he”story 0.19% of tokensto you because she loves you
-
#551
Fires on “⏎”agent 2.00% of tokensnums if n % 2 == 0]⏎3:
-
#552
Fires on “<|user_start|>”agent 0.76% of tokensbut they wanted to try.⏎The ants worked as a team
-
#553
Fires on “⏎⏎”python 0.86% of tokensdef excite(s):⏎ return s + "!"⏎⏎⏎print
-
#554
Fires on “7”worksheet 1.51% of tokens⏎7+0: 7+0=7,
-
#555
Fires on “ed”agent 0.43% of tokens: return s[0]<|tool_end|><|assistant_start|><|tool_call_start|>edit<|arg|>
-
#556
Fires on “ you”story 0.08% of tokensIt's fun and makes me feel good. Do you want to
-
#557
Fires on “```”python 0.73% of tokens⏎```⏎⏎
-
#558
Fires on “ an”agent 1.30% of tokensecute, lsp<|system_end|><|system_start|>You are an AI agent
-
#559
Fires on “ agent”agent 5.84% of tokensexecute<|system_end|><|system_start|>You are an AI agent running in
-
#560
Fires on “4”worksheet 0.19% of tokens4+8
-
#561
Fires on “ The”story 0.87% of tokenslittle bird saw the plane and wanted to help. The bird told
-
#562
Fires on “<|assistant_end|>”chat 0.99% of tokensI can only tell short stories and add numbers.<|assistant_end|><|bos|>Tom
-
#563
Fires on “def”agent 0.19% of tokensand said, "Of course we can. But next time,
-
#564
Fires on “ agent”agent 1.18% of tokensare an AI agent running in OpenCode, a coding agent harness.
-
#565
Fires on “ town”story 0.43% of tokens<|assistant_end|><|bos|>Once upon a time, in a small town, there
-
#566
Fires on “def”python 0.69% of tokensreturn a * a`.⏎⏎```python⏎def product(
-
#567
Fires on “ careful”python 0.25% of tokenstheir mom said. "But you have to be careful with other
-
#568
Fires on “,”story 0.85% of tokensThe fairy said, "Tim
-
#569
Fires on “⏎”worksheet 0.36% of tokens94 = 94514.⏎83
-
#570
Fires on “.”story 2.71% of tokensit was hard. He asked his mom for help. She showed
-
#571
Fires on “ two”agent 0.08% of tokensfaces.<|bos|>Once upon a time, there were two animals,
-
#572
Fires on “0”worksheet 1.25% of tokensHow many balls does Anna have now?⏎0000
-
#573
Fires on “ mom”story 0.41% of tokensyoung boy named Tim went to the store with his mom. They
-
#574
Fires on “ c”story 0.39% of tokensgreetings.py
-
#575
Fires on “ue”agent 0.70% of tokenswelcome<|arg|>newString=greet<|arg|>replaceAll=true<|tool_call_end|><|assistant_end|>
-
#576
Fires on “9”worksheet 0.36% of tokens84.⏎Tim had 3946 flowers and
-
#577
Fires on “ tree”story 0.80% of tokenstime, there was an enormous tree. This tree was so
-
#578
Fires on “ were”story 0.53% of tokens, the box opened. Inside the box, there were many colorful
-
#579
Fires on “:”worksheet 1.69% of tokens: 5
-
#580
Fires on “ of”worksheet 0.14% of tokens104550.<|bos|>The sum of 8
-
#581
Fires on “ strong”story 0.34% of tokenshave an idea! Let's show my dad how clever and good
-
#582
Fires on “Once”story 0.42% of tokens2=9, 9<|think_end|>9<|assistant_end|><|bos|>Once upon a
-
#583
Fires on “ Tim”story 2.17% of tokensnamed Tim went to
-
#584
Fires on “Make”agent 0.68% of tokensOpenCode, a coding agent harness.<|system_end|><|user_start|>"Make a new
-
#585
Fires on “ unexpected”story 0.91% of tokensbaby nice and clean.⏎But, then something unexpected happened!
-
#586
Fires on “ Tim”story 0.28% of tokens?<|assistant_end|><|bos|>One day, a strong boy named Tom found a
-
#587
Fires on “ can”story 0.17% of tokensby step or with a calculator.<|assistant_end|><|user_start|>How can you help
-
#588
Fires on “ not”agent 0.18% of tokensyou to have fun with them. Just be careful not to make
-
#589
Fires on “,”story 0.81% of tokens<|assistant_end|><|bos|>Once upon a time, there was
-
#590
Fires on “⏎ ”python 0.69% of tokens.py⏎def includes(items, x):⏎ return x
-
#591
Fires on “ first”python 0.66% of tokens):⏎ return s.upper()⏎⏎⏎def first_letter