Timezone: »
Deep networks have achieved impressive performance in various domains, but their applications are largely limited by the prohibitive computational overhead. In this paper, we propose a novel algorithm, namely collaborative channel pruning (CCP), to reduce the computational overhead with negligible performance degradation. The joint impact of pruned/preserved channels on the loss function is quantitatively analyzed, and such inter-channel dependency is exploited to determine which channels to be pruned. The channel selection problem is then reformulated as a constrained 0-1 quadratic optimization problem, and the Hessian matrix, which is essential in constructing the above optimization, can be efficiently approximated. Empirical evaluation on two benchmark data sets indicates that our proposed CCP algorithm achieves higher classification accuracy with similar computational complexity than other state-of-the-art channel pruning algorithms.
Author Information
Hanyu Peng (Shenzhen Institutes of Advanced Technology,Chinese Academy of Sciences)
Jiaxiang Wu (Tencent AI Lab)
Shifeng Chen (SIAT)
Junzhou Huang (University of Texas at Arlington / Tencent AI Lab)
Related Events (a corresponding poster, oral, or spotlight)
-
2019 Poster: Collaborative Channel Pruning for Deep Networks »
Wed. Jun 12th 01:30 -- 04:00 AM Room Pacific Ballroom #141
More from the Same Authors
-
2022 : Hypergraph Convolutional Networks via Equivalence Between Hypergraphs and Undirected Graphs »
Jiying Zhang · fuyang li · Xi Xiao · Tingyang Xu · Yu Rong · Junzhou Huang · Yatao Bian -
2022 Poster: Efficient Test-Time Model Adaptation without Forgetting »
Shuaicheng Niu · Jiaxiang Wu · Yifan Zhang · Yaofo Chen · Shijian Zheng · Peilin Zhao · Mingkui Tan -
2022 Spotlight: Efficient Test-Time Model Adaptation without Forgetting »
Shuaicheng Niu · Jiaxiang Wu · Yifan Zhang · Yaofo Chen · Shijian Zheng · Peilin Zhao · Mingkui Tan -
2022 Poster: Local Augmentation for Graph Neural Networks »
Songtao Liu · Rex (Zhitao) Ying · Hanze Dong · Lanqing Li · Tingyang Xu · Yu Rong · Peilin Zhao · Junzhou Huang · Dinghao Wu -
2022 Spotlight: Local Augmentation for Graph Neural Networks »
Songtao Liu · Rex (Zhitao) Ying · Hanze Dong · Lanqing Li · Tingyang Xu · Yu Rong · Peilin Zhao · Junzhou Huang · Dinghao Wu -
2022 Poster: Frustratingly Easy Transferability Estimation »
Long-Kai Huang · Junzhou Huang · Yu Rong · Qiang Yang · Ying WEI -
2022 Spotlight: Frustratingly Easy Transferability Estimation »
Long-Kai Huang · Junzhou Huang · Yu Rong · Qiang Yang · Ying WEI -
2021 Poster: Improving Generalization in Meta-learning via Task Augmentation »
Huaxiu Yao · Long-Kai Huang · Linjun Zhang · Ying WEI · Li Tian · James Zou · Junzhou Huang · Zhenhui (Jessie) Li -
2021 Poster: Learning Diverse-Structured Networks for Adversarial Robustness »
Xuefeng Du · Jingfeng Zhang · Bo Han · Tongliang Liu · Yu Rong · Gang Niu · Junzhou Huang · Masashi Sugiyama -
2021 Spotlight: Improving Generalization in Meta-learning via Task Augmentation »
Huaxiu Yao · Long-Kai Huang · Linjun Zhang · Ying WEI · Li Tian · James Zou · Junzhou Huang · Zhenhui (Jessie) Li -
2021 Spotlight: Learning Diverse-Structured Networks for Adversarial Robustness »
Xuefeng Du · Jingfeng Zhang · Bo Han · Tongliang Liu · Yu Rong · Gang Niu · Junzhou Huang · Masashi Sugiyama -
2021 Poster: AdaXpert: Adapting Neural Architecture for Growing Data »
Shuaicheng Niu · Jiaxiang Wu · Guanghui Xu · Yifan Zhang · Yong Guo · Peilin Zhao · Peng Wang · Mingkui Tan -
2021 Spotlight: AdaXpert: Adapting Neural Architecture for Growing Data »
Shuaicheng Niu · Jiaxiang Wu · Guanghui Xu · Yifan Zhang · Yong Guo · Peilin Zhao · Peng Wang · Mingkui Tan -
2021 Poster: Meta-learning Hyperparameter Performance Prediction with Neural Processes »
Ying WEI · Peilin Zhao · Junzhou Huang -
2021 Spotlight: Meta-learning Hyperparameter Performance Prediction with Neural Processes »
Ying WEI · Peilin Zhao · Junzhou Huang -
2020 Poster: Breaking the Curse of Space Explosion: Towards Efficient NAS with Curriculum Search »
Yong Guo · Yaofo Chen · Yin Zheng · Peilin Zhao · Jian Chen · Junzhou Huang · Mingkui Tan -
2019 Poster: Hierarchically Structured Meta-learning »
Huaxiu Yao · Ying WEI · Junzhou Huang · Zhenhui (Jessie) Li -
2019 Poster: RaFM: Rank-Aware Factorization Machines »
Xiaoshuang Chen · Yin Zheng · Jiaxing Wang · Wenye Ma · Junzhou Huang -
2019 Oral: Hierarchically Structured Meta-learning »
Huaxiu Yao · Ying WEI · Junzhou Huang · Zhenhui (Jessie) Li -
2019 Oral: RaFM: Rank-Aware Factorization Machines »
Xiaoshuang Chen · Yin Zheng · Jiaxing Wang · Wenye Ma · Junzhou Huang -
2018 Poster: Adversarial Learning with Local Coordinate Coding »
Jiezhang Cao · Yong Guo · Qingyao Wu · Chunhua Shen · Junzhou Huang · Mingkui Tan -
2018 Poster: Error Compensated Quantized SGD and its Applications to Large-scale Distributed Optimization »
Jiaxiang Wu · Weidong Huang · Junzhou Huang · Tong Zhang -
2018 Oral: Adversarial Learning with Local Coordinate Coding »
Jiezhang Cao · Yong Guo · Qingyao Wu · Chunhua Shen · Junzhou Huang · Mingkui Tan -
2018 Oral: Error Compensated Quantized SGD and its Applications to Large-scale Distributed Optimization »
Jiaxiang Wu · Weidong Huang · Junzhou Huang · Tong Zhang -
2018 Poster: Transfer Learning via Learning to Transfer »
Ying WEI · Yu Zhang · Junzhou Huang · Qiang Yang -
2018 Oral: Transfer Learning via Learning to Transfer »
Ying WEI · Yu Zhang · Junzhou Huang · Qiang Yang