Timezone: »

Nyström Method with Kernel K-means++ Samples as Landmarks
Dino Oglic · Thomas Gaertner

Wed Aug 09 01:30 AM -- 05:00 AM (PDT) @ Gallery #143

We investigate, theoretically and empirically, the effectiveness of kernel K-means++ samples as landmarks in the Nyström method for low-rank approximation of kernel matrices. Previous empirical studies (Zhang et al., 2008; Kumar et al.,2012) observe that the landmarks obtained using (kernel) K-means clustering define a good low-rank approximation of kernel matrices. However, the existing work does not provide a theoretical guarantee on the approximation error for this approach to landmark selection. We close this gap and provide the first bound on the approximation error of the Nystrom method with kernel K-means++ samples as landmarks. Moreover, for the frequently used Gaussian kernel we provide a theoretically sound motivation for performing Lloyd refinements of kernel K-means++ landmarks in the instance space. We substantiate our theoretical results empirically by comparing the approach to several state-of-the-art algorithms.

Author Information

Dino Oglic (University of Bonn)
Thomas Gaertner (The University of Nottingham)

Related Events (a corresponding poster, oral, or spotlight)

More from the Same Authors