Skip to content
mini-lab
Features of prelude-2

Feature #3985

Fires on “Write” (not labeled yet: read the examples)

Fires on
0.24% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 43%
  • chat 37%
  • python 12%
  • story 8%
  • worksheet 0%

Makes the model say

ce themoldStringsef getting not sum

Makes it not say

.defappy2 girl0 and while

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 3.8
    on his back, as they had many fun adventures together.<|bos|><|user_start|>Write a short story about
  2. chat 3.74
    her face.<|assistant_end|><|bos|><|system_start|>Answer in one short sentence.<|system_end|><|user_start|>Write a short story about
  3. chat 3.68
    and help others.<|bos|><|system_start|>Answer in one short sentence.<|system_end|><|user_start|>Write a story for me
  4. chat 3.68
    but he always had fun with his friends in the woods.<|bos|><|user_start|>Write a short story about
  5. chat 3.65
    little while, they forgot about the war and were happy.<|bos|><|user_start|>Write a story for me
  6. chat 3.65
    7853 = 77853.<|bos|><|user_start|>Write a short story about
  7. chat 3.63
    ready have.<|bos|><|system_start|>Answer in one short sentence.<|system_end|><|user_start|>Write a short story about
  8. chat 3.57
    !<|user_end|><|assistant_start|>Goodbye! Have a nice day.<|assistant_end|><|user_start|>Write a short story about
  9. chat 3.57
    it was too late. Her fine toy was gone forever.<|bos|><|user_start|>Write a short story about
  10. chat 3.53
    a big dragon. The dragon was very organized.<|assistant_end|><|user_start|>Write a short story about
  11. chat 3.53
    Thank you very much!<|user_end|><|assistant_start|>Happy to help!<|assistant_end|><|user_start|>Write a short story about
  12. chat 3.53
    best of friends forever.<|bos|><|user_start|>Write a short story about