Timezone: »
The task of text classification is usually divided into two stages: text feature extraction and classification. In this standard formalization, categories are merely represented as indexes in the label vocabulary, and the model lacks for explicit instructions on what to classify. Inspired by the current trend of formalizing NLP problems as question answering tasks, we propose a new framework for text classification, in which each category label is associated with a category description. Descriptions are generated by hand-crafted templates or using abstractive/extractive models from reinforcement learning. The concatenation of the description and the text is fed to the classifier to decide whether or not the current label should be assigned to the text. The proposed strategy forces the model to attend to the most salient texts with respect to the label, which can be regarded as a hard version of attention, leading to better performances. We observe significant performance boosts over strong baselines on a wide range of text classification tasks including single-label classification, multi-label classification and multi-aspect sentiment analysis.
Author Information
Duo Chai (Shannon.AI)
Wei Wu (Shannon.AI)
Qinghong Han (Shannon.AI)
Fei Wu (Zhejiang University, China)
Jiwei Li (Shannon.AI)
More from the Same Authors
-
2023 Poster: Stable Estimation of Heterogeneous Treatment Effects »
Anpeng Wu · Kun Kuang · Ruoxuan Xiong · Bo Li · Fei Wu -
2022 Poster: The Role of Deconfounding in Meta-learning »
Yinjie Jiang · Zhengyu Chen · Kun Kuang · Luotian Yuan · Xinhai Ye · Zhihua Wang · Fei Wu · Ying WEI -
2022 Poster: Instrumental Variable Regression with Confounder Balancing »
Anpeng Wu · Kun Kuang · Bo Li · Fei Wu -
2022 Spotlight: Instrumental Variable Regression with Confounder Balancing »
Anpeng Wu · Kun Kuang · Bo Li · Fei Wu -
2022 Spotlight: The Role of Deconfounding in Meta-learning »
Yinjie Jiang · Zhengyu Chen · Kun Kuang · Luotian Yuan · Xinhai Ye · Zhihua Wang · Fei Wu · Ying WEI -
2021 Poster: KD3A: Unsupervised Multi-Source Decentralized Domain Adaptation via Knowledge Distillation »
Haozhe Feng · Zhaoyang You · Minghao Chen · Tianye Zhang · Minfeng Zhu · Fei Wu · Chao Wu · Wei Chen -
2021 Spotlight: KD3A: Unsupervised Multi-Source Decentralized Domain Adaptation via Knowledge Distillation »
Haozhe Feng · Zhaoyang You · Minghao Chen · Tianye Zhang · Minfeng Zhu · Fei Wu · Chao Wu · Wei Chen