Abstract:
We study the asymptotic error of score-based diffusion model sampling in large-sample scenarios from a non-parametric statistics perspective. We show that a kernel-based score estimator achieves an optimal mean square error of for the score function of , where and represent the sample size and the dimension, is bounded above and below by polynomials of , and is an arbitrary sub-Gaussian distribution. As a consequence, this yields an upper bound for the total variation error of the distribution of the sample generated by the diffusion model under a mere sub-Gaussian assumption. If in addition, belongs to the nonparametric family of the -Sobolev space with , by adopting an early stopping strategy, we obtain that the diffusion model is nearly (up to log factors) minimax optimal. This removes the crucial lower bound assumption on in previous proofs of the minimax optimality of the diffusion model for nonparametric families.
Chat is not available.