Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #34

Fires on “ how” (not labeled yet: read the examples)

Fires on
0.31% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 40%
  • python 34%
  • agent 17%
  • story 9%
  • worksheet 1%

Makes the model say

item `_ miniultipl number len biggest

Makes it not say

'rer friends TheWhenelhead

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 3.83
    <|assistant_start|>I'm prelude, and I know how to tell little stories and how to add numbers.
  2. chat 3.8
    <|assistant_start|>I'm prelude, and I know how to tell little stories and how to add numbers.
  3. chat 3.79
    <|assistant_start|>I'm prelude, and I know how to tell little stories and how to add numbers.
  4. chat 3.7
    <|assistant_start|>I'm prelude, and I know how to tell little stories and how to add numbers.
  5. chat 3.68
    <|assistant_start|>I'm prelude, and I know how to tell little stories and how to add numbers.
  6. chat 3.68
    <|assistant_start|>I'm prelude, and I know how to tell little stories and how to add numbers.
  7. chat 3.68
    <|assistant_start|>I'm prelude, and I know how to tell little stories and how to add numbers.
  8. chat 3.65
    <|assistant_start|>I'm prelude, and I know how to tell little stories and how to add numbers.
  9. chat 3.62
    <|assistant_start|>I'm prelude, and I know how to tell little stories and how to add numbers.
  10. chat 3.62
    Goodbye! Have a nice day.<|assistant_end|><|bos|><|system_start|>Start every answer with "Sure
  11. chat 3.62
    <|assistant_start|>I'm prelude, and I know how to tell little stories and how to add numbers.
  12. chat 3.6
    <|assistant_start|>I'm prelude, and I know how to tell little stories and how to add numbers.