Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #1597

Fires on “ and” (not labeled yet: read the examples)

Fires on
0.31% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 46%
  • chat 39%
  • story 13%
  • python 2%
  • worksheet 1%

Makes the model say

help code to): hurt will tell calculator

Makes it not say

They andOnce from + themnumsa

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 2.08
    <|user_end|><|assistant_start|>I'm prelude: I can tell you short stories for children and add numbers, step
  2. chat 2.07
    <|user_end|><|assistant_start|>I'm prelude: I can tell you short stories for children and add numbers, step
  3. chat 2.02
    <|user_end|><|assistant_start|>I'm prelude: I can tell you short stories for children and add numbers, step
  4. chat 2.02
    <|user_end|><|assistant_start|>I'm prelude: I can tell you short stories for children and add numbers, step
  5. chat 2.02
    <|user_end|><|assistant_start|>I'm prelude: I can tell you short stories for children and add numbers, step
  6. chat 2.02
    <|user_end|><|assistant_start|>I'm prelude: I can tell you short stories for children and add numbers, step
  7. chat 2.0
    <|user_end|><|assistant_start|>I'm prelude: I can tell you short stories for children and add numbers, step
  8. chat 2.0
    <|user_end|><|assistant_start|>I'm prelude: I can tell you short stories for children and add numbers, step
  9. chat 1.99
    <|user_end|><|assistant_start|>I'm prelude: I can tell you short stories for children and add numbers, step
  10. chat 1.99
    <|user_end|><|assistant_start|>I'm prelude: I can tell you short stories for children and add numbers, step
  11. chat 1.98
    <|user_end|><|assistant_start|>I'm prelude: I can tell you short stories for children and add numbers, step
  12. chat 1.98
    <|user_end|><|assistant_start|>I'm prelude: I can tell you short stories for children and add numbers, step