Skip to content
mini-lab
Features of prelude-2

Feature #863

Fires on “e” (not labeled yet: read the examples)

Fires on
0.34% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 73%
  • story 18%
  • python 4%
  • chat 3%
  • worksheet 2%

Makes the model say

mess show dirty do cleanow puddle repeat

Makes it not say

equals[-json >newStringice = ""

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 2.49
    We sure did!" Lucy said with a happy smile.⏎And that's how their bright and
  2. story 2.41
    story is that if you plan properly, you can achieve anything!<|bos|>
  3. story 2.24
    man! The fish was not a nice friend after all. And that is the end of the
  4. story 2.17
    always remind her of the beautiful tree, and what she can achieve when she puts
  5. agent 1.93
    bfetch, websearch, write, execute<|system_end|><|system_start|>
  6. story 1.92
    ball every day, and they became the best of friends. And that is how they learned that
  7. agent 1.92
    bfetch, websearch, write, execute<|system_end|><|system_start|>
  8. story 1.91
    bird was so small, it couldn't do anything.⏎And that was the bad end of
  9. story 1.9
    her older brother walked into the room. He had a mischievous smile on
  10. agent 1.89
    bfetch, websearch, write, execute, g
  11. agent 1.89
    bfetch, websearch, write, execute
  12. story 1.89
    that now they could play together