Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #3851

Fires on “!” (not labeled yet: read the examples)

Fires on
0.84% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 48%
  • python 20%
  • chat 17%
  • story 12%
  • worksheet 2%

Makes the model say

items True comes two[-items %ar

Makes it not say

sopython should joutils0 but say

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 3.36
    !".<|system_end|><|user_start|>Write a short story about a boat.<|user_end|><|assistant_start|>Sure! One day, a
  2. chat 3.28
    "Sure!".<|system_end|><|user_start|>Once upon a time...<|user_end|><|assistant_start|>Sure! Once upon a
  3. chat 3.26
    !".<|system_end|><|user_start|>Tell me a story about a boat.<|user_end|><|assistant_start|>Sure! One day, there
  4. chat 3.25
    "Sure!".<|system_end|><|user_start|>Tell me a short story.<|user_end|><|assistant_start|>Sure! One day, a
  5. chat 3.25
    !".<|system_end|><|user_start|>Tell me a story about a cat.<|user_end|><|assistant_start|>Sure! Once upon a
  6. chat 3.14
    "Sure!".<|system_end|><|user_start|>Once upon a time...<|user_end|><|assistant_start|>Sure! Once upon a
  7. chat 3.13
    "Sure!".<|system_end|><|user_start|>Tell me a short story.<|user_end|><|assistant_start|>Sure! One day, a
  8. chat 3.13
    !".<|system_end|><|user_start|>I want a story about the sea!<|user_end|><|assistant_start|>Sure! Once upon a
  9. chat 3.11
    !".<|system_end|><|user_start|>Write a short story about a bird.<|user_end|><|assistant_start|>Sure! One day, a
  10. chat 3.1
    !".<|system_end|><|user_start|>Tell me a story about a bird.<|user_end|><|assistant_start|>Sure! One day, a
  11. chat 3.09
    "Sure!".<|system_end|><|user_start|>Once upon a time...<|user_end|><|assistant_start|>Sure! Once upon a
  12. python 3.05
    listlib.py⏎def includes(items, x):⏎ return x in items⏎⏎⏎def