Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #1687

Fires on “ a” (not labeled yet: read the examples)

Fires on
0.99% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 44%
  • story 37%
  • chat 15%
  • python 3%
  • worksheet 1%

Makes the model say

happy big little min small dog p very

Makes it not say

,<|arg|><|assistant_end|>".<|tool_start|>], Why

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 4.07
    she was a baby.⏎She
  2. story 3.64
    s of wild animals, from lions to monkeys. It was a fun place for people
  3. story 3.5
    esday. Tuesday liked to help everyone. He was a very good dog.
  4. story 3.4
    a rare, yummy treat for dinner. It was a big, soft cake
  5. story 3.38
    exciting to explore. One day the rabbit found a party. It was a very special party.
  6. story 3.38
    bye to their friends and went home. The loud party was a lot of fun for
  7. story 3.37
    thing in her piece of cake. It was a new doll with a
  8. chat 3.35
    .<|bos|><|user_start|>What's your name?<|user_end|><|assistant_start|>I'm prelude, a very small language model
  9. story 3.35
    the farm the most wonderful things. He was a great friend and everyone
  10. agent 3.32
    ecute<|system_end|><|system_start|>You are an AI agent running in OpenCode, a coding agent harness.
  11. chat 3.32
    !<|assistant_end|><|user_start|>What's your name?<|user_end|><|assistant_start|>I'm prelude, a very small language model
  12. agent 3.31
    ecute<|system_end|><|system_start|>You are an AI agent running in OpenCode, a coding agent harness.