Skip to content
mini-lab
Features of prelude-2

Feature #265

Fires on “ item” (not labeled yet: read the examples)

Fires on
0.80% of tokens
Mostly in
python
Layer
after block 4

Where it fires

  • python 36%
  • agent 30%
  • chat 23%
  • story 6%
  • worksheet 5%

Makes the model say

of brother<|tool_call_end|> to family in_ function

Makes it not say

ajson returns soa lots jo mean

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. python 6.62
    .<|assistant_end|><|bos|>Bug: `max_item` should return the biggest item of nums, but
  2. python 6.28
    ?<|assistant_end|><|bos|>Bug: `max_item` should return the biggest item of nums, but
  3. python 6.18
    tests passed⏎<|bos|>Bug: `power` should return a to the power of b, but
  4. python 6.07
    Bug: `max_item` should return the biggest item of nums, but
  5. python 6.04
    s[0]⏎```⏎⏎`initial` returns the first letter of s. For
  6. python 6.02
    ⏎```⏎⏎Bug: `power` should return a to the power of b, but
  7. python 5.98
    numbers.<|assistant_end|><|bos|>Bug: `power` should return a to the power of b, but
  8. python 5.97
    )` returns the first letter of s.⏎
  9. python 5.96
    ]⏎```⏎⏎Bug: `biggest` should return the biggest item of nums, but
  10. python 5.93
    + "!"⏎```⏎⏎Bug: `size` should return the length of s, but
  11. python 5.91
    93.<|bos|>Bug: `num_chars` should return the length of s, but
  12. python 5.85
    3.<|assistant_end|><|bos|>Bug: `power` should return a to the power of b, but