Invited Talk
in
Workshop: Efficient Multimodal Question Answering Sat, Jul 11, 2026 • 8:10 AM – 8:50 AM KST

🟦 Naman Goyal & Jenny Ni: Multimodal Robustness Under Distribution Shift

Naman Goyal ⋅ Jenny Ni

Abstract

As multimodal systems become integrated into user-facing applications, traditional automated metrics (e.g., BLEU, FID) fail to capture the nuances of human preference and utility. We will explore how to design query sets, establish human-in-the-loop evaluation pipelines, and develop new metrics that correlate strongly with human-centered outcomes.

Speakers

Naman Goyal

Jenny Ni

Video

Chat is not available.