Timezone: »

 
Oral
Collaborative Channel Pruning for Deep Networks
Hanyu Peng · Jiaxiang Wu · Shifeng Chen · Junzhou Huang

Tue Jun 11 04:20 PM -- 04:25 PM (PDT) @ Seaside Ballroom
in Applications: Computer Vision »

Deep networks have achieved impressive performance in various domains, but their applications are largely limited by the prohibitive computational overhead. In this paper, we propose a novel algorithm, namely collaborative channel pruning (CCP), to reduce the computational overhead with negligible performance degradation. The joint impact of pruned/preserved channels on the loss function is quantitatively analyzed, and such inter-channel dependency is exploited to determine which channels to be pruned. The channel selection problem is then reformulated as a constrained 0-1 quadratic optimization problem, and the Hessian matrix, which is essential in constructing the above optimization, can be efficiently approximated. Empirical evaluation on two benchmark data sets indicates that our proposed CCP algorithm achieves higher classification accuracy with similar computational complexity than other state-of-the-art channel pruning algorithms.

[ Slides]  [ Video] 

Author Information

Hanyu Peng (Shenzhen Institutes of Advanced Technology,Chinese Academy of Sciences)
Jiaxiang Wu (Tencent AI Lab)
Shifeng Chen (SIAT)
Junzhou Huang (University of Texas at Arlington / Tencent AI Lab)

Related Events (a corresponding poster, oral, or spotlight)

More from the Same Authors