Timezone: »
Fatorization machines (FM) are a popular model class to learn pairwise interactions by a low-rank approximation. Different from existing FM-based approaches which use a fixed rank for all features, this paper proposes a Rank-Aware FM (RaFM) model which adopts pairwise interactions from embeddings with different ranks. The proposed model achieves a better performance on real-world datasets where different features have significantly varying frequencies of occurrences. Moreover, we prove that the RaFM model can be stored, evaluated, and trained as efficiently as one single FM, and under some reasonable conditions it can be even significantly more efficient than FM. RaFM improves the performance of FMs in both regression tasks and classification tasks while incurring less computational burden, therefore also has attractive potential in industrial applications.
Author Information
Xiaoshuang Chen (Tsinghua Univerisity)
Yin Zheng (Tencent AI Lab)
Yin Zheng received the Ph.D degree from Tsinghua University under the supervision of Prof. Yu-Jin Zhang (Tsinghua University) and Prof. Hugo Larochelle (Google Brain). His research interest is Deep Learning, Machine Learning, Computer Vision, Artificial Intelligence and Recommender Systems. After graduation at 2015, he work as a researcher in the recommendation team of Hulu LLC. Then he joined Tencent AI Lab as a researcher in Machine Learning center.
Jiaxing Wang (Institute of Automation, Chinese Academy of Sciences)
Wenye Ma (Tencent)
Junzhou Huang (University of Texas at Arlington / Tencent AI Lab)
Related Events (a corresponding poster, oral, or spotlight)
-
2019 Oral: RaFM: Rank-Aware Factorization Machines »
Thu. Jun 13th 04:30 -- 04:35 PM Room Room 201
More from the Same Authors
-
2022 : Hypergraph Convolutional Networks via Equivalence Between Hypergraphs and Undirected Graphs »
Jiying Zhang · fuyang li · Xi Xiao · Tingyang Xu · Yu Rong · Junzhou Huang · Yatao Bian -
2022 Poster: Local Augmentation for Graph Neural Networks »
Songtao Liu · Rex (Zhitao) Ying · Hanze Dong · Lanqing Li · Tingyang Xu · Yu Rong · Peilin Zhao · Junzhou Huang · Dinghao Wu -
2022 Spotlight: Local Augmentation for Graph Neural Networks »
Songtao Liu · Rex (Zhitao) Ying · Hanze Dong · Lanqing Li · Tingyang Xu · Yu Rong · Peilin Zhao · Junzhou Huang · Dinghao Wu -
2022 Poster: Frustratingly Easy Transferability Estimation »
Long-Kai Huang · Junzhou Huang · Yu Rong · Qiang Yang · Ying WEI -
2022 Spotlight: Frustratingly Easy Transferability Estimation »
Long-Kai Huang · Junzhou Huang · Yu Rong · Qiang Yang · Ying WEI -
2021 Poster: Improving Generalization in Meta-learning via Task Augmentation »
Huaxiu Yao · Long-Kai Huang · Linjun Zhang · Ying WEI · Li Tian · James Zou · Junzhou Huang · Zhenhui (Jessie) Li -
2021 Poster: Learning Diverse-Structured Networks for Adversarial Robustness »
Xuefeng Du · Jingfeng Zhang · Bo Han · Tongliang Liu · Yu Rong · Gang Niu · Junzhou Huang · Masashi Sugiyama -
2021 Spotlight: Improving Generalization in Meta-learning via Task Augmentation »
Huaxiu Yao · Long-Kai Huang · Linjun Zhang · Ying WEI · Li Tian · James Zou · Junzhou Huang · Zhenhui (Jessie) Li -
2021 Spotlight: Learning Diverse-Structured Networks for Adversarial Robustness »
Xuefeng Du · Jingfeng Zhang · Bo Han · Tongliang Liu · Yu Rong · Gang Niu · Junzhou Huang · Masashi Sugiyama -
2021 Poster: Meta-learning Hyperparameter Performance Prediction with Neural Processes »
Ying WEI · Peilin Zhao · Junzhou Huang -
2021 Spotlight: Meta-learning Hyperparameter Performance Prediction with Neural Processes »
Ying WEI · Peilin Zhao · Junzhou Huang -
2021 Poster: DouZero: Mastering DouDizhu with Self-Play Deep Reinforcement Learning »
Daochen Zha · Jingru Xie · Wenye Ma · Sheng Zhang · Xiangru Lian · Xia Hu · Ji Liu -
2021 Spotlight: DouZero: Mastering DouDizhu with Self-Play Deep Reinforcement Learning »
Daochen Zha · Jingru Xie · Wenye Ma · Sheng Zhang · Xiangru Lian · Xia Hu · Ji Liu -
2020 Poster: Breaking the Curse of Space Explosion: Towards Efficient NAS with Curriculum Search »
Yong Guo · Yaofo Chen · Yin Zheng · Peilin Zhao · Jian Chen · Junzhou Huang · Mingkui Tan -
2019 Poster: Hierarchically Structured Meta-learning »
Huaxiu Yao · Ying WEI · Junzhou Huang · Zhenhui (Jessie) Li -
2019 Oral: Hierarchically Structured Meta-learning »
Huaxiu Yao · Ying WEI · Junzhou Huang · Zhenhui (Jessie) Li -
2019 Poster: Collaborative Channel Pruning for Deep Networks »
Hanyu Peng · Jiaxiang Wu · Shifeng Chen · Junzhou Huang -
2019 Oral: Collaborative Channel Pruning for Deep Networks »
Hanyu Peng · Jiaxiang Wu · Shifeng Chen · Junzhou Huang -
2018 Poster: Adversarial Learning with Local Coordinate Coding »
Jiezhang Cao · Yong Guo · Qingyao Wu · Chunhua Shen · Junzhou Huang · Mingkui Tan -
2018 Poster: Error Compensated Quantized SGD and its Applications to Large-scale Distributed Optimization »
Jiaxiang Wu · Weidong Huang · Junzhou Huang · Tong Zhang -
2018 Oral: Adversarial Learning with Local Coordinate Coding »
Jiezhang Cao · Yong Guo · Qingyao Wu · Chunhua Shen · Junzhou Huang · Mingkui Tan -
2018 Oral: Error Compensated Quantized SGD and its Applications to Large-scale Distributed Optimization »
Jiaxiang Wu · Weidong Huang · Junzhou Huang · Tong Zhang -
2018 Poster: Transfer Learning via Learning to Transfer »
Ying WEI · Yu Zhang · Junzhou Huang · Qiang Yang -
2018 Oral: Transfer Learning via Learning to Transfer »
Ying WEI · Yu Zhang · Junzhou Huang · Qiang Yang