Skip to content
mini-lab
Features of prelude-2

Feature #494

Fires on “ fish” (not labeled yet: read the examples)

Fires on
0.52% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 56%
  • story 21%
  • agent 20%
  • python 2%
  • worksheet 1%

Makes the model say

that need or withThat + minus want

Makes it not say

checkhesFalseiong "!") cheered

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 5.23
    is 80.<|assistant_end|><|bos|><|user_start|>Tell me a story about a fish.<|user_end|><|assistant_start|>Once
  2. chat 5.21
    by mini-lab.<|assistant_end|><|bos|><|user_start|>Tell me a story about a fish.<|user_end|><|assistant_start|>Once
  3. chat 5.12
    one short sentence.<|system_end|><|user_start|>Can you tell me a story about a fish?<|user_end|><|assistant_start|>One
  4. chat 5.11
    th it in the end.<|bos|><|user_start|>Tell me a story about a fish.<|user_end|><|assistant_start|>Once
  5. chat 5.06
    answer is 90.<|assistant_end|><|user_start|>Write a short story about a fish.<|user_end|><|assistant_start|>Once
  6. chat 5.06
    had many fun adventures together.<|bos|><|user_start|>Write a short story about a ball.<|user_end|><|assistant_start|>Once
  7. chat 5.03
    somebody in need.<|bos|><|user_start|>Tell me a story about a fish.<|user_end|><|assistant_start|>Once
  8. chat 5.03
    nice day.<|assistant_end|><|user_start|>can you tell me a story about a ball<|user_end|><|assistant_start|>Once upon
  9. chat 5.03
    Answer in one short sentence.<|system_end|><|user_start|>Tell me a story about a fish.<|user_end|><|assistant_start|>Once
  10. chat 5.02
    Answer in one short sentence.<|system_end|><|user_start|>Tell me a story about a ball.<|user_end|><|assistant_start|>Once
  11. chat 4.98
    with a calculator.<|assistant_end|><|user_start|>Can you tell me a story about a ball?<|user_end|><|assistant_start|>Once
  12. chat 4.9
    one short sentence.<|system_end|><|user_start|>Can you tell me a story about a fish?<|user_end|><|assistant_start|>Once