Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #2610

Fires on “ one” (not labeled yet: read the examples)

Fires on
0.72% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 46%
  • worksheet 36%
  • chat 11%
  • story 5%
  • python 2%

Makes the model say

txt returnO green twistrement")?

Makes it not say

Lily well`: princessup So fell nest

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 2.57
    best treasure hunters in the world.<|bos|><|system_start|>Answer in one short sentence.<|system_end|>
  2. chat 2.54
    can help you solve problems and help others.<|bos|><|system_start|>Answer in one short sentence.<|system_end|>
  3. chat 2.48
    30<|think_end|>1230<|assistant_end|><|bos|><|system_start|>Answer in one short sentence.<|system_end|>
  4. chat 2.48
    their day. They were the best of friends.<|bos|><|system_start|>Answer in one short sentence.<|system_end|>
  5. chat 2.44
    very happy he found the box with the toys.<|bos|><|system_start|>Answer in one short sentence.<|system_end|>
  6. chat 2.44
    how to pay. They were happy friends again.<|bos|><|system_start|>Answer in one short sentence.<|system_end|>
  7. chat 2.44
    , they all played with the toy car together.<|bos|><|system_start|>Answer in one short sentence.<|system_end|>
  8. chat 2.42
    friends and never take candy from strangers.<|bos|><|system_start|>Answer in one short sentence.<|system_end|>
  9. chat 2.38
    . And they all lived happily ever after.<|assistant_end|><|bos|><|system_start|>Answer in one short sentence.<|system_end|>
  10. chat 2.35
    know how to tell stories and add numbers.<|assistant_end|><|bos|><|system_start|>Answer in one short sentence.<|system_end|>
  11. chat 2.35
    iating what you already have.<|bos|><|system_start|>Answer in one short sentence.<|system_end|>
  12. chat 2.35
    , 659<|think_end|>659<|assistant_end|><|bos|><|system_start|>Answer in one short sentence.<|system_end|>