Features of prelude-2
Inside the model, every token is a list of numbers that mix many things at once. A sparse autoencoder, trained on the residual stream after block 4, splits it into 4,096 directions, few of them active at a time: each one tends to mean one thing, like “the last digit of a number” or “a story begins”. Shaded tokens show where a feature fires.
- Features
- 4,096
- Loss recovered
- 98.9%
- Variance unexplained
- 7.3%
- Model loss, with the features
- 2.565 → 2.631
4,096 features.
-
#3399
Fires on “,”agent 0.43% of tokens<|system_end|><|system_start|>You are an AI agent running in OpenCode, a coding
-
#3400
Fires on “ project”agent 0.08% of tokensedy. Share your toys and your joy with your
-
#3401
Fires on “ what”python 0.19% of tokenssurprised because it
-
#3402
Fires on “⏎”worksheet 0.86% of tokens⏎⏎$ python3 main.py⏎m⏎t⏎
-
#3403
Fires on “d”agent 0.98% of tokensmonkey!" The monkey smiled and said, "Always ask
-
#3404
Fires on “ a”story 1.29% of tokens, there was a dog named Spot. Spot was a perfect dog
-
#3405
Fires on “ help”story 0.16% of tokensto the animal who lived next door and asked for help.⏎
-
#3406
Fires on “ had”agent 0.20% of tokenscan do special things."
-
#3407
Fires on “ safe”story 0.76% of tokensa small hole. He liked to keep his home clean and cozy
-
#3408
Fires on “ ”worksheet 0.63% of tokens8965+4685: 5+
-
#3409
Fires on “Fixed”agent 0.79% of tokens(1 replacement)<|tool_end|><|assistant_start|>Renamed `combine
-
#3410
Fires on “ something”story 0.30% of tokens. They were very thoughtful and wanted to do something special.
-
#3411
Fires on “ it”story 0.39% of tokens.⏎In the end, Amy learned that sometimes it's important
-
#3412
Fires on “.”story 0.97% of tokens. She saw something shiny and round in the sand. She ran
-
#3413
Fires on “1”chat 0.59% of tokens<|tool_start|>136<|tool_end|><|assistant_start|>The answer is 136
-
#3414
Fires on “5”worksheet 0.48% of tokens7 plus 44311 equals 443
-
#3415
Fires on “<|user_end|>”chat 1.67% of tokens<|assistant_end|><|bos|><|user_start|>Add 9 and 9.<|user_end|><|assistant_start|><|think_start|>
-
#3416
Fires on “def”python 0.65% of tokens`.<|assistant_end|><|bos|># main.py⏎from tools import add_
-
#3417
Fires on “ a”story 0.81% of tokenssome juice to drink. The cat liked the juice a lot.
-
#3418
Fires on “ old”worksheet 0.71% of tokenslived a boy named Jack. He was three years old and loved
-
#3419
Fires on “ For”agent 0.65% of tokens`excite` returns s with an exclamation mark. For example,
-
#3420
Fires on “<|bos|>”chat 0.61% of tokensday playing with the treasure in the park.<|assistant_end|><|bos|>Once upon
-
#3421
Fires on “ blew”story 0.93% of tokens, something unexpected happened. A big wind came and blew the tie
-
#3422
Fires on “py”agent 1.25% of tokensthere!⏎<|tool_end|><|assistant_start|>Created `greeting.py`. It
-
#3423
Fires on “_”python 0.68% of tokensis 133.<|assistant_end|><|bos|>`count_items(
-
#3424
Fires on “+”worksheet 0.68% of tokens+58: 0+8+1=
-
#3425
Fires on “.”story 0.18% of tokenssmall town, there lived a little boy named Tom. Tom liked
-
#3426
Fires on “ob”agent 0.52% of tokensfail. Fix it.<|user_end|><|assistant_start|><|tool_call_start|>glob<|arg|>pattern
-
#3427
Fires on “Ex”agent 0.30% of tokenswitch had a good day.<|assistant_end|><|bos|><|user_start|>Explain qu
-
#3428
Fires on “ last”agent 0.61% of tokens<|tool_start|>Traceback (most recent call last):⏎
-
#3429
Fires on “ went”story 0.22% of tokensto sleep. She took her baby doll everywhere she went.⏎
-
#3430
Fires on “ and”story 1.37% of tokensand Max were playing outside. Tom threw a ball and Max ran
-
#3431
Fires on “Can”agent 0.45% of tokens<|bos|><|system_start|>Answer in one short sentence.<|system_end|><|user_start|>Can you tell
-
#3432
Fires on “3”worksheet 0.55% of tokens73: 0+3=3
-
#3433
Fires on “=”worksheet 1.30% of tokens424: 7+4+1=12
-
#3434
Fires on “6”worksheet 1.11% of tokens, 13650⏎So 896
-
#3435
Fires on “ numbers”chat 0.12% of tokensmodel: I can only tell short stories and add numbers.<|assistant_end|>
-
#3436
Fires on “ "”python 0.19% of tokensbut it has `return "Hello, " + name
-
#3437
Fires on “ is”python 0.45% of tokens<|user_start|>What is your name?<|user_end|><|assistant_start|>My name is prelude.
-
#3438
Fires on “ write”agent 0.51% of tokensfetch, websearch, write, ex
-
#3439
Fires on “Tom”story 2.30% of tokensso he decided to share it with Lily.⏎Tom said,
-
#3440
Fires on “ are”agent 0.22% of tokens, write, execute<|system_end|><|system_start|>You are an AI
-
#3441
Fires on “⏎”worksheet 0.09% of tokens76 and 41148.⏎00
-
#3442
Fires on “.”agent 0.59% of tokens, a coding agent harness.<|system_end|><|user_start|>Run app.py for
-
#3443
Fires on “ always”agent 0.54% of tokensgirl named Lucy. Lucy was a dependable girl who always kept her
-
#3444
Fires on “ me”worksheet 0.33% of tokenslittle stories and how to add numbers. Try asking me for a
-
#3445
Fires on “+”worksheet 0.31% of tokens2⏎4+8: 4+8+
-
#3446
Fires on “ is”story 0.65% of tokenssaid, "I told you too much salt is not good
-
#3447
Fires on “x”python 0.66% of tokens/ len(nums)⏎⏎⏎def magnitude(x):⏎
-
#3448
Fires on “⏎⏎”python 0.30% of tokenssmallest(nums):⏎ return min(nums)⏎⏎⏎print