Oral
Collective Model Fusion for Multiple Black-Box Experts
Minh Hoang · Nghia Hoang · Bryan Kian Hsiang Low · Carleton Kingsford

Wed Jun 12th 11:30 -- 11:35 AM @ Room 103

Model fusion is a fundamental problem in collective machine learning (ML) where independent experts with heterogeneous learning architectures are required to combine expertise to improve predictive performance. This is particularly challenging in information-sensitive domains (e.g., medical records in health-care analytics) where experts do not have access to each other's internal architecture and local data. To address this challenge, this paper presents the first collective model fusion framework for multiple experts with heterogeneous black-box architectures. The proposed method will enable this by addressing the following key issues of how black-box experts interact to understand the predictive behaviors of one another; how these understandings can be represented and shared efficiently among themselves; and how the shared understandings can be combined to generate high-quality consensus prediction. The performance of the resulting framework is analyzed theoretically and demonstrated empirically on several datasets.

Author Information

Minh Hoang (Carnegie Mellon University)
Nghia Hoang (MIT-IBM Watson AI Lab, IBM Research)
Bryan Kian Hsiang Low (National University of Singapore)
Carleton Kingsford (Carnegie Mellon University)

Related Events (a corresponding poster, oral, or spotlight)

More from the Same Authors