Invited Talk
in
Workshop: Efficient Multimodal Question Answering Fri, Jul 10, 2026 • 4:10 PM – 4:50 PM PDT

🟦 Naman Goyal & Jenny Ni: Multimodal Robustness Under Distribution Shift

Naman Goyal ⋅ Jenny Ni

Abstract

As multimodal systems become integrated into user-facing applications, traditional automated metrics (e.g., BLEU, FID) fail to capture the nuances of human preference and utility. We will explore how to design query sets, establish human-in-the-loop evaluation pipelines, and develop new metrics that correlate strongly with human-centered outcomes.

Speakers

Naman Goyal

Jenny Ni

Video

Chat is not available.