Timezone: »
Poster
Convergence and Recovery Guarantees of the K-Subspaces Method for Subspace Clustering
Peng Wang · Huikang Liu · Anthony Man-Cho So · Laura Balzano
The K-subspaces (KSS) method is a generalization of the K-means method for subspace clustering. In this work, we present local convergence analysis and a recovery guarantee for KSS, assuming data are generated by the semi-random union of subspaces model, where $N$ points are randomly sampled from $K \ge 2$ overlapping subspaces. We show that if the initial assignment of the KSS method lies within a neighborhood of a true clustering, it converges at a superlinear rate and finds the correct clustering within $\Theta(\log\log N)$ iterations with high probability. Moreover, we propose a thresholding inner-product based spectral method for initialization and prove that it produces a point in this neighborhood. We also present numerical results of the studied method to support our theoretical developments.
Author Information
Peng Wang (University of Michigan)
Huikang Liu (Imperial College London)
Anthony Man-Cho So (The Chinese University of Hong Kong)
Laura Balzano (University of Michigan)
Related Events (a corresponding poster, oral, or spotlight)
-
2022 Spotlight: Convergence and Recovery Guarantees of the K-Subspaces Method for Subspace Clustering »
Tue. Jul 19th 08:20 -- 08:25 PM Room Room 309
More from the Same Authors
-
2021 : Identification and Adaptive Control of Markov Jump Systems: Sample Complexity and Regret Bounds »
Yahya Sattar · Zhe Du · Davoud Ataee Tarzanagh · Necmiye Ozay · Laura Balzano · Samet Oymak -
2023 Poster: Projected Tensor Power Method for Hypergraph Community Recovery »
Jinxin Wang · Yuen-Man Pun · Xiaolu Wang · Peng Wang · Anthony Man-Cho So -
2022 Poster: On the Finite-Time Complexity and Practical Computation of Approximate Stationarity Concepts of Lipschitz Functions »
Lai Tian · Kaiwen Zhou · Anthony Man-Cho So -
2022 Spotlight: On the Finite-Time Complexity and Practical Computation of Approximate Stationarity Concepts of Lipschitz Functions »
Lai Tian · Kaiwen Zhou · Anthony Man-Cho So -
2021 Poster: Optimal Non-Convex Exact Recovery in Stochastic Block Model via Projected Power Method »
Peng Wang · Huikang Liu · Zirui Zhou · Anthony Man-Cho So -
2021 Spotlight: Optimal Non-Convex Exact Recovery in Stochastic Block Model via Projected Power Method »
Peng Wang · Huikang Liu · Zirui Zhou · Anthony Man-Cho So -
2020 Poster: A Nearly-Linear Time Algorithm for Exact Community Recovery in Stochastic Block Model »
Peng Wang · Zirui Zhou · Anthony Man-Cho So -
2020 Poster: Preference Modeling with Context-Dependent Salient Features »
Amanda Bower · Laura Balzano -
2017 Poster: Algebraic Variety Models for High-Rank Matrix Completion »
Greg Ongie · Laura Balzano · Rebecca Willett · Robert Nowak -
2017 Talk: Algebraic Variety Models for High-Rank Matrix Completion »
Greg Ongie · Laura Balzano · Rebecca Willett · Robert Nowak -
2017 Poster: Leveraging Union of Subspace Structure to Improve Constrained Clustering »
John Lipor · Laura Balzano -
2017 Talk: Leveraging Union of Subspace Structure to Improve Constrained Clustering »
John Lipor · Laura Balzano