Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #518

Fires on “ has” (not labeled yet: read the examples)

Fires on
0.78% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 58%
  • chat 32%
  • agent 9%
  • python 1%
  • story 1%

Makes the model say

<|arg|><|assistant_start|>oldString<|system_end|>): "$: mini

Makes it not say

7608951 and

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 2.29
    174 = 26618.<|bos|><|user_start|>Lucy has 18 coins
  2. chat 2.23
    add numbers. Try asking me for a story!<|assistant_end|><|bos|><|user_start|>Lucy has 6 balls.
  3. chat 2.22
    that sometimes you need to let go to help others.<|bos|><|user_start|>Sam has 63 coins
  4. chat 2.22
    played more games at the camp.<|assistant_end|><|bos|><|user_start|>Sue has 42 balls
  5. chat 2.14
    ⏎2 plus 55 equals 57.<|bos|><|user_start|>Lucy has 1 coins.
  6. chat 2.06
    , Tim only put safe things in his jar.<|assistant_end|><|bos|><|user_start|>Lucy has 4 stars.
  7. chat 2.03
    nums):⏎ return min(nums)⏎```⏎<|bos|><|user_start|>Mia has 1 toys.
  8. chat 2.01
    6<|tool_end|><|assistant_start|>The answer is 56.<|assistant_end|><|bos|><|user_start|>Tim has 74 cookies
  9. chat 1.98
    <|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>Sue has 55 coins
  10. chat 1.98
    lists.py` with `last(items)`.<|assistant_end|><|bos|><|user_start|>Lucy has 211
  11. chat 1.98
    the tests" or "Rename add to plus".<|assistant_end|><|bos|><|user_start|>Anna has 87 stars
  12. chat 1.97
    1955 equals 5985.<|bos|><|user_start|>Anna has 3 apples.