Skip to yearly menu bar Skip to main content

Contributed talk
Workshop: Negative Dependence and Submodularity: Theory and Applications in Machine Learning

Ensemble Kernel Methods, Implicit Regularization and Determinantal Point Processes

Joachim Schreurs · MichaĆ«l Fanuel · Johan Suykens


By using the framework of Determinantal Point Processes (DPPs), some theoretical results concerning the interplay between diversity and regularization can be obtained. In this paper we show that sampling subsets with kDPPs results in implicit regularization in the context of ridgeless Kernel Regression. Furthermore, we leverage the common setup of state-of-the-art DPP algorithms to sample multiple small subsets and use them in an ensemble of ridgeless regressions. Our first empirical results indicate that ensemble of ridgeless regressors can be interesting to use for datasets including redundant information.

Chat is not available.