Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #1552

Fires on “ tell” (not labeled yet: read the examples)

Fires on
0.98% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 52%
  • agent 38%
  • python 5%
  • story 4%
  • worksheet 0%

Makes the model say

short Pythong uponing intoupper trained

Makes it not say

They got The they waited felt town saw

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 4.0
    My name is prelude. I'm a tiny language model: I can tell short stories and add
  2. chat 3.96
    My name is prelude. I'm a tiny language model: I can tell short stories and add
  3. chat 3.96
    My name is prelude. I'm a tiny language model: I can tell short stories and add
  4. chat 3.91
    My name is prelude. I'm a tiny language model: I can tell short stories and add
  5. chat 3.9
    My name is prelude. I'm a tiny language model: I can tell short stories and add
  6. chat 3.89
    I'm a tiny language model: I can tell short stories and add
  7. chat 3.81
    My name is prelude. I'm a tiny language model: I can tell short stories and add
  8. chat 3.81
    My name is prelude. I'm a tiny language model: I can tell short stories and add
  9. chat 3.78
    <|user_start|>What can you do?<|user_end|><|assistant_start|>I'm prelude: I can tell you short stories for
  10. chat 3.76
    My name is prelude. I'm a tiny language model: I can tell short stories and add
  11. chat 3.74
    My name is prelude. I'm a tiny language model: I can tell short stories and add
  12. chat 3.73
    My name is prelude. I'm a tiny language model: I can tell short stories and add