Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #3003

Fires on “ very” (not labeled yet: read the examples)

Fires on
0.10% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 42%
  • story 41%
  • agent 15%
  • python 2%
  • worksheet 1%

Makes the model say

happy functions:*'sON<|tool_call_end|>

Makes it not say

away There open thereFrom two are colors

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 3.31
    ed to the garden.⏎The moral of this story is that when someone point
  2. story 3.23
    helped Lily write a new poem. The moral of the story is to always forgive others
  3. chat 3.08
    <|bos|><|user_start|>Tell me about yourself.<|user_end|><|assistant_start|>I'm prelude, a very small language model trained
  4. chat 3.07
    <|assistant_end|><|bos|><|user_start|>Who made you?<|user_end|><|assistant_start|>I'm prelude, a very small language model trained
  5. story 3.01
    in the forest was even happier.⏎The moral of the story is: Listen
  6. story 3.01
    they could play together with the yarn. The moral of the story is that sometimes, it
  7. story 3.0
    and the musician lost his favorite hat.⏎The moral of the story is that not everyone wants
  8. chat 2.95
    <|bos|><|user_start|>What's your name?<|user_end|><|assistant_start|>I'm prelude, a very small language model trained
  9. chat 2.95
    <|bos|><|user_start|>Tell me about yourself.<|user_end|><|assistant_start|>I'm prelude, a very small language model trained
  10. chat 2.92
    calculator<|system_end|><|user_start|>Who are you?<|user_end|><|assistant_start|>I'm prelude, a very small language model trained
  11. chat 2.92
    <|assistant_end|><|user_start|>Tell me about yourself.<|user_end|><|assistant_start|>I'm prelude, a very small language model trained
  12. chat 2.91
    .<|assistant_end|><|user_start|>what is your name<|user_end|><|assistant_start|>I'm prelude, a very small language model trained