Timezone: »
Most existing feature selection methods in literature are linear models, so that the nonlinear relations between features and response variables are not considered. Meanwhile, in these feature selection models, the interactions between features are often ignored or just discussed under prior structure information. To address these challenging issues, we consider the problem of sparse additive models for high-dimensional nonparametric regression with the allowance of the flexible interactions between features. A new method, called as sparse shrunk additive models (SSAM), is proposed to explore the structure information among features. This method bridges sparse kernel regression and sparse feature selection. Theoretical results on the convergence rate and sparsity characteristics of SSAM are established by the novel analysis techniques with integral operator and concentration estimate. In particular, our algorithm and theoretical analysis only require the component functions to be continuous and bounded, which are not necessary to be in reproducing kernel Hilbert spaces. Experiments on both synthetic and real-world data demonstrate the effectiveness of the proposed approach.
Author Information
guodong liu (university of Pittsburgh)
Hong Chen (Huazhong Agricultural University)
Heng Huang (University of Pittsburgh & JD Finance America Corporation)
More from the Same Authors
-
2023 Oral: Tilted Sparse Additive Models »
Yingjie Wang · Hong Chen · Weifeng Liu · Fengxiang He · Tieliang Gong · YouCheng Fu · Dacheng Tao -
2023 Poster: Tighter Analysis for ProxSkip »
Zhengmian Hu · Heng Huang -
2023 Poster: A Law of Robustness beyond Isoperimetry »
Yihan Wu · Heng Huang · Hongyang Zhang -
2023 Poster: Beyond Lipschitz Smoothness: A Tighter Analysis for Nonconvex Optimization »
Zhengmian Hu · Xidong Wu · Heng Huang -
2023 Poster: Tilted Sparse Additive Models »
Yingjie Wang · Hong Chen · Weifeng Liu · Fengxiang He · Tieliang Gong · YouCheng Fu · Dacheng Tao -
2023 Poster: Detecting Out-of-distribution Data through In-distribution Class Prior »
Xue JIANG · Feng Liu · zhen fang · Hong Chen · Tongliang Liu · Feng Zheng · Bo Han -
2022 Poster: On the Convergence of Local Stochastic Compositional Gradient Descent with Momentum »
Hongchang Gao · Junyi Li · Heng Huang -
2022 Spotlight: On the Convergence of Local Stochastic Compositional Gradient Descent with Momentum »
Hongchang Gao · Junyi Li · Heng Huang -
2022 Poster: RetrievalGuard: Provably Robust 1-Nearest Neighbor Image Retrieval »
Yihan Wu · Hongyang Zhang · Heng Huang -
2022 Poster: Detached Error Feedback for Distributed SGD with Random Sparsification »
An Xu · Heng Huang -
2022 Spotlight: Detached Error Feedback for Distributed SGD with Random Sparsification »
An Xu · Heng Huang -
2022 Spotlight: RetrievalGuard: Provably Robust 1-Nearest Neighbor Image Retrieval »
Yihan Wu · Hongyang Zhang · Heng Huang -
2021 Poster: On the Random Conjugate Kernel and Neural Tangent Kernel »
Zhengmian Hu · Heng Huang -
2021 Spotlight: On the Random Conjugate Kernel and Neural Tangent Kernel »
Zhengmian Hu · Heng Huang -
2020 Poster: Momentum-Based Policy Gradient Methods »
Feihu Huang · Shangqian Gao · Jian Pei · Heng Huang -
2020 Poster: Adversarial Nonnegative Matrix Factorization »
lei luo · yanfu Zhang · Heng Huang -
2020 Poster: Can Stochastic Zeroth-Order Frank-Wolfe Method Converge Faster for Non-Convex Problems? »
Hongchang Gao · Heng Huang -
2020 Poster: Fast OSCAR and OWL Regression via Safe Screening Rules »
Runxue Bao · Bin Gu · Heng Huang -
2019 Poster: Demystifying Dropout »
Hongchang Gao · Jian Pei · Heng Huang -
2019 Oral: Demystifying Dropout »
Hongchang Gao · Jian Pei · Heng Huang -
2019 Poster: Faster Stochastic Alternating Direction Method of Multipliers for Nonconvex Optimization »
Feihu Huang · Songcan Chen · Heng Huang -
2019 Oral: Faster Stochastic Alternating Direction Method of Multipliers for Nonconvex Optimization »
Feihu Huang · Songcan Chen · Heng Huang -
2018 Poster: Faster Derivative-Free Stochastic Algorithm for Shared Memory Machines »
Bin Gu · Zhouyuan Huo · Cheng Deng · Heng Huang -
2018 Poster: Decoupled Parallel Backpropagation with Convergence Guarantee »
Zhouyuan Huo · Bin Gu · Qian Yang · Heng Huang -
2018 Oral: Decoupled Parallel Backpropagation with Convergence Guarantee »
Zhouyuan Huo · Bin Gu · Qian Yang · Heng Huang -
2018 Oral: Faster Derivative-Free Stochastic Algorithm for Shared Memory Machines »
Bin Gu · Zhouyuan Huo · Cheng Deng · Heng Huang