Features of prelude-2
Inside the model, every token is a list of numbers that mix many things at once. A sparse autoencoder, trained on the residual stream after block 4, splits it into 4,096 directions, few of them active at a time: each one tends to mean one thing, like “the last digit of a number” or “a story begins”. Shaded tokens show where a feature fires.
- Features
- 4,096
- Loss recovered
- 98.9%
- Variance unexplained
- 7.3%
- Model loss, with the features
- 2.565 → 2.631
4,096 features.
-
#1495
Fires on “ so”story 0.30% of tokensthe animal, "We must make your home stronger so it won
-
#1496
Fires on “,”story 0.46% of tokenskids liked to play under the tree. One day, a little
-
#1497
Fires on “ small”agent 0.43% of tokens5<|assistant_end|><|bos|>Once upon a time, in a small house near
-
#1498
Fires on “ want”story 0.73% of tokensTim said, "Hi, Bob! Do you want to surf
-
#1499
Fires on “ to”agent 0.59% of tokenscatch, so he asked his friend, Kitty, to play with
-
#1500
Fires on “ an”story 0.31% of tokensbe more quiet next time." They made the cocoa together
-
#1501
Fires on “4”agent 0.59% of tokens+ 65 = 37234.<|bos|>
-
#1502
Fires on “_”story 0.16% of tokens2⏎1: def how_many(
-
#1503
Fires on “ should”agent 1.07% of tokens` should return the
-
#1504
Fires on “ nums”python 0.58% of tokensmin_item` should return the smallest number in nums, but
-
#1505
Fires on “ is”chat 0.78% of tokens<|tool_call_end|><|assistant_end|><|tool_start|>320<|tool_end|><|assistant_start|>The answer is 3
-
#1506
Fires on “ toy”story 2.62% of tokenstoy. They
-
#1507
Fires on “ cheer”story 0.51% of tokens⏎5⏎```<|assistant_end|><|bos|>One day, a cheerful girl
-
#1508
Fires on “ +”worksheet 0.36% of tokensabout having a big house.<|bos|>Calculate 2 + 4
-
#1509
Fires on “⏎”worksheet 3.47% of tokens<|bos|>Calculate 200 + 2.⏎20
-
#1510
Fires on “Let”story 0.71% of tokenswere very excited.⏎"Let's go
-
#1511
Fires on “ can”story 0.46% of tokens<|assistant_end|><|user_start|>Good morning!<|user_end|><|assistant_start|>Hello! How can I help
-
#1512
Fires on “ friends”python 0.21% of tokens2725.<|bos|>Lily and Tom are friends. They
-
#1513
Fires on “<|system_end|>”agent 0.37% of tokensagent running in OpenCode, a coding agent harness.<|system_end|><|user_start|>size
-
#1514
Fires on “3”python 0.13% of tokensconfig.json"⏎}⏎⏎$ python3 test_
-
#1515
Fires on “ walk”story 0.59% of tokens⏎"tac"⏎<|bos|>Jimmy was walking in the
-
#1516
Fires on “.”story 1.57% of tokensMia had a big garden where she loved to play. In her
-
#1517
Fires on “ build”story 0.65% of tokenswas a girl named Lily. Lily loved to design things.
-
#1518
Fires on “ stories”chat 0.47% of tokenshelp with that. I only know how to tell stories and add
-
#1519
Fires on “ to”story 0.37% of tokensHe just wanted to stare
-
#1520
Fires on “=”agent 1.10% of tokens=print(gret("Max"))<|arg|>newString=print(
-
#1521
Fires on “=**/”agent 1.79% of tokensproject?"<|user_end|><|assistant_start|><|tool_call_start|>glob<|arg|>pattern=**/*<|tool_call_end|>
-
#1522
Fires on “ do”agent 0.50% of tokensaris.<|user_end|><|assistant_start|>Sorry, I can't do that:
-
#1523
Fires on “ it”story 0.94% of tokenssaw a shiny nail on the ground. He picked it up and
-
#1524
Fires on “ and”chat 0.35% of tokenswith that. I only know how to tell stories and add numbers
-
#1525
Fires on “ if”chat 0.15% of tokensanswer is 7.<|assistant_end|><|user_start|>What if you add
-
#1526
Fires on “ a”chat 0.41% of tokensAnswer in one short sentence.<|system_end|><|user_start|>Tell me a story.
-
#1527
Fires on “ snow”story 1.95% of tokenshis tail and barked happily. They went to the store and bought
-
#1528
Fires on “ Lily”chat 0.23% of tokens12 more cookies. How many cookies does Lily have now
-
#1529
Fires on “ number”agent 0.26% of tokenstail(items)`.<|assistant_end|><|bos|><|system_start|>Answer with the number only.
-
#1530
Fires on “3”chat 1.59% of tokens237 balls. Ben gets 370 more
-
#1531
Fires on “ a”story 0.41% of tokens.⏎One day, Fluffy decided to go for a walk around
-
#1532
Fires on “ ”worksheet 1.53% of tokens⏎048+191: 8+
-
#1533
Fires on “Let”story 0.20% of tokensThe big cat said to the small dog, "Let's play
-
#1534
Fires on “!"”story 0.29% of tokenstoo close to the hedge. "Ouch!" cried the
-
#1535
Fires on “ in”python 0.84% of tokens<|assistant_start|>`smallest(nums)` returns the smallest number in nums.
-
#1536
Fires on “`”python 1.15% of tokens⏎⏎Fix: replace `return x * x` with `
-
#1537
Fires on “ a”agent 0.30% of tokens<|system_start|>You are an AI agent running in OpenCode, a coding agent
-
#1538
Fires on “ a”agent 0.84% of tokensa cake.
-
#1539
Fires on “:”agent 0.46% of tokensis 111.<|assistant_end|><|bos|><|system_start|>tools: edit,
-
#1540
Fires on “p”agent 0.65% of tokens_of to larger."<|user_end|><|assistant_start|><|tool_call_start|>grep<|arg|>pattern
-
#1541
Fires on “8”worksheet 1.03% of tokensyou add 6661 and 28 for me
-
#1542
Fires on “3”worksheet 0.29% of tokens9160 and 89475, you
-
#1543
Fires on “ a”agent 1.18% of tokensSorry, I can't do that: I'm a tiny model
-
#1544
Fires on “ "”story 1.27% of tokensains could stop and go. They made noises like "choo