KAD: No More FAD! An Effective and Efficient Evaluation Metric for Audio Generation
Abstract
In this paper, we introduce the Kernel Audio Distance -- a novel, distribution-free, unbiased, and computationally efficient metric based on Maximum Mean Discrepancy (MMD). We propose it as an alternative to the widely adopted Frechet Audio Distance (FAD), which suffers from significant limitations, including reliance on Gaussian assumptions, sensitivity to sample size, and high computational complexity. Through analysis and empirical validation, we demonstrate KAD’s advantages: (1) faster convergence with smaller sample sizes, enabling reliable evaluation with limited data; (2) lower computational cost, with scalable GPU acceleration; and (3) stronger alignment with human perceptual evaluations. We open-source the KAD toolkit, \texttt{kadtk}, providing an official benchmark metric for generative audio models.