Skip to yearly menu bar Skip to main content


Spotlight Poster

Minimax Optimality of Score-based Diffusion Models: Beyond the Density Lower Bound Assumptions

Kaihong Zhang · Heqi Yin · Feng Liang · Jingbo Liu

Hall C 4-9 #1806

Abstract: We study the asymptotic error of score-based diffusion model sampling in large-sample scenarios from a non-parametric statistics perspective. We show that a kernel-based score estimator achieves an optimal mean square error of O~(n1td+22(td21)) for the score function of p0N(0,tId), where n and d represent the sample size and the dimension, t is bounded above and below by polynomials of n, and p0 is an arbitrary sub-Gaussian distribution. As a consequence, this yields an O~(n1/2td4) upper bound for the total variation error of the distribution of the sample generated by the diffusion model under a mere sub-Gaussian assumption. If in addition, p0 belongs to the nonparametric family of the β-Sobolev space with β2, by adopting an early stopping strategy, we obtain that the diffusion model is nearly (up to log factors) minimax optimal. This removes the crucial lower bound assumption on p0 in previous proofs of the minimax optimality of the diffusion model for nonparametric families.

Chat is not available.