Enhanced Multi-Instance Partial Label Learning via Average Gradient Outer Product
Abstract
Lay Summary
Enhanced Multi-Instance Partial Label Learning via Average Gradient Outer Product (ICML 2026, submission 25270) Machine-learning systems usually need large amounts of carefully labeled data, but accurate labels are expensive. In many real settings the labels are doubly imperfect. Take an image labeled by several crowd workers: the image is really a collection of small regions, only some of which matter, and the workers may disagree, so the image arrives with a short list of candidate labels of which only one is correct. A method has to figure out at the same time which regions are important and which candidate label is the true one, and the wrong candidates can easily mislead it. We introduce AGOPMIPL, which handles both problems with a single idea. Rather than trusting the noisy labels directly, it looks across the entire training set to find which characteristics the model consistently relies on when making decisions, and then reshapes the data to emphasize exactly those characteristics. This steers the model's attention onto the regions that genuinely determine the label, and it gradually sorts the true label out from the candidates as training proceeds. On standard benchmarks and a real colorectal-cancer image dataset labeled by non-experts, AGOPMIPL is consistently more accurate than the best existing methods, improving accuracy by up to about 26% in the hardest real-world case. This could make learning from cheap, crowd-sourced, or otherwise weakly labeled data more reliable.