$\lambda$-PSD: Scalable Approximate SNR-Optimised Polynomial Stein Discrepancies
Minh L Nguyen ⋅ Thanh Long Vu ⋅ Christopher Drovandi ⋅ Leah South ⋅ TrungTin Nguyen
Abstract
Polynomial Stein discrepancies (PSD) provide a scalable alternative to kernel Stein methods for measuring sample quality and goodness-of-fit testing, but their statistical properties remain poorly understood. We show that increasing polynomial degree primarily amplifies signal without adequately controlling variance, rather than directly optimising the signal-to-noise ratio (SNR). Under suitable assumptions, this might lead to a failure mode in which the SNR can provably decay factorially with polynomial degree. Motivated by this observation, we reformulate Stein discrepancy construction as an explicit SNR maximisation problem, yielding a Rayleigh quotient over Stein features. This perspective motivates $\lambda$-PSD, an approximate scalable covariance-aware reweighting scheme defined in a low-dimensional subspace. Under Gaussian settings, we show that $\lambda$-PSD avoids the factorial SNR collapse and admits a constant SNR equal to the Fisher divergence. Empirically, $\lambda$-PSD substantially improves test power while retaining linear-time complexity in the number of samples, highlighting the importance of SNR-aware design for scalable Stein discrepancies
Chat is not available.
Successful Page Load