Timezone: »

Attention-based Deep Multiple Instance Learning
Maximilian Ilse · Jakub Tomczak · Max Welling

Fri Jul 13 09:15 AM -- 12:00 PM (PDT) @ Hall B #66

Multiple instance learning (MIL) is a variation of supervised learning where a single class label is assigned to a bag of instances. In this paper, we state the MIL problem as learning the Bernoulli distribution of the bag label where the bag label probability is fully parameterized by neural networks. Furthermore, we propose a neural network-based permutation-invariant aggregation operator that corresponds to the attention mechanism. Notably, an application of the proposed attention-based operator provides insight into the contribution of each instance to the bag label. We show empirically that our approach achieves comparable performance to the best MIL methods on benchmark MIL datasets and it outperforms other methods on a MNIST-based MIL dataset and two real-life histopathology datasets without sacrificing interpretability.

Author Information

Maximilian Ilse (University of Amsterdam)
Jakub Tomczak (Qualcomm AI Research)
Max Welling (University of Amsterdam)

Related Events (a corresponding poster, oral, or spotlight)

More from the Same Authors