Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #1535

Fires on “ in” (not labeled yet: read the examples)

Fires on
0.84% of tokens
Mostly in
python
Layer
after block 4

Where it fires

  • python 47%
  • agent 42%
  • chat 5%
  • story 4%
  • worksheet 2%

Makes the model say

nums items "items S vowelsas mouse

Makes it not say

rite?y returnsBenmdoldString there

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. agent 8.07
    in nums]<|tool_end|><|assistant_start|>`smallest(nums)` returns the smallest number in nums.<|assistant_end|><|bos|>
  2. python 7.53
    .<|assistant_end|><|bos|>`min_item(nums)` returns the smallest number in nums.⏎⏎
  3. python 7.52
    (nums)` returns the smallest number in nums.⏎⏎
  4. python 7.48
    ⏎```⏎⏎Bug: `smallest` should return the smallest number in nums, but it
  5. agent 7.47
    )<|tool_end|><|assistant_start|>`min_item(nums)` returns the smallest number in nums.<|assistant_end|><|bos|>
  6. python 7.4
    .<|assistant_end|><|bos|>`min_item(nums)` returns the smallest number in nums.⏎⏎
  7. python 7.33
    ⏎⏎Bug: `min_item` should return the smallest number in nums, but it
  8. python 7.28
    ⏎⏎Bug: `min_item` should return the smallest number in nums, but it
  9. python 7.2
    `.⏎⏎`max_item(nums)` returns the largest number in nums.⏎⏎
  10. python 7.14
    ⏎```⏎⏎Bug: `smallest` should return the smallest number in nums, but it
  11. python 7.13
    (nums)⏎```⏎⏎`smallest` returns the smallest number in nums. For example
  12. python 7.11
    ⏎⏎Bug: `max_item` should return the largest number in nums, but it