Timezone: »

 
Federated Conformal Predictors for Distributed Uncertainty Quantification
Charles Lu · Yaodong Yu · Sai Praneeth Karimireddy · Michael Jordan · Ramesh Raskar

@
in Federated Learning and Analytics in Practice: Algorithms, Systems, Applications, and Opportunities »
Event URL: https://openreview.net/forum?id=qEPYJNHNCo »

Conformal prediction is a popular paradigm for providing rigorous uncertainty quantification that can be applied to already trained models. We present an extension of conformal prediction to federated learning. The main challenge is data heterogeneity across the clients, which violates the fundamental tenet of \emph{exchangeability} required for conformal prediction. Instead, we propose a weaker notion of \emph{partial exchangeability} which is better suited to the FL setting, and use it to develop the Federated Conformal Prediction (FCP) framework. We show FCP enjoys rigorous theoretical guarantees as well as excellent empirical performance on several computer vision and medical imaging datasets. Our results demonstrate a practical approach to incorporating meaningful uncertainty quantification in distributed and heterogeneous environments.

Author Information

Charles Lu (MIT)
Yaodong Yu (UC Berkeley)
Sai Praneeth Karimireddy (EPFL)
Michael Jordan (UC Berkeley)
Ramesh Raskar (Massachusetts Institute of Technology)

More from the Same Authors