Timezone: »
In this paper, we investigate general single-index models (SIMs) in high dimensions. Based on U-statistics, we propose two types of robust estimators for the recovery of model parameters, which can be viewed as generalizations of several existing algorithms for one-bit compressed sensing (1-bit CS). With minimal assumption on noise, the statistical guarantees are established for the generalized estimators under suitable conditions, which allow general structures of underlying parameter. Moreover, the proposed estimator is novelly instantiated for SIMs with monotone transfer function, and the obtained estimator can better leverage the monotonicity. Experimental results are provided to support our theoretical analyses.
Author Information
Sheng Chen (University of Minnesota)
Arindam Banerjee (University of Minnesota)

Arindam Banerjee is a Founder Professor at the Department of Computer Science, University of Illinois Urbana-Champaign. His research interests are in machine learning. His current research focuses on computational and statistical aspects of over-parameterized models including deep learning, spatial and temporal data analysis, generative models, and sequential decision making problems. His work also focuses on applications of machine learning in complex real-world and scientific domains including problems in climate science and ecology. He has won several awards, including the NSF CAREER award, the IBM Faculty Award, and six best paper awards in top-tier venues.
Related Events (a corresponding poster, oral, or spotlight)
-
2017 Poster: Robust Structured Estimation with Single-Index Models »
Wed. Aug 9th 08:30 AM -- 12:00 PM Room Gallery #58
More from the Same Authors
-
2022 Poster: Stability Based Generalization Bounds for Exponential Family Langevin Dynamics »
Arindam Banerjee · Tiancong Chen · Xinyan Li · Yingxue Zhou -
2022 Spotlight: Stability Based Generalization Bounds for Exponential Family Langevin Dynamics »
Arindam Banerjee · Tiancong Chen · Xinyan Li · Yingxue Zhou -
2022 Poster: Smoothed Adversarial Linear Contextual Bandits with Knapsacks »
Vidyashankar Sivakumar · Shiliang Zuo · Arindam Banerjee -
2022 Spotlight: Smoothed Adversarial Linear Contextual Bandits with Knapsacks »
Vidyashankar Sivakumar · Shiliang Zuo · Arindam Banerjee -
2020 Poster: Structured Linear Contextual Bandits: A Sharp and Geometric Smoothed Analysis »
Vidyashankar Sivakumar · Steven Wu · Arindam Banerjee -
2017 Poster: High-Dimensional Structured Quantile Regression »
Vidyashankar Sivakumar · Arindam Banerjee -
2017 Talk: High-Dimensional Structured Quantile Regression »
Vidyashankar Sivakumar · Arindam Banerjee