An adaptive convolution with label embedding for text classification

被引:5
|
作者
Tan, Changgeng [1 ]
Ren, Yuan [1 ]
Wang, Chen [1 ]
机构
[1] Cent South Univ, Changsha, Hunan, Peoples R China
关键词
Text classification; Label embedding; CNN; Adaptive filters;
D O I
10.1007/s10489-021-02702-x
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Convolutional neural network (CNNs) has made a breakthrough since deep learning was employed to text classification. However, the traditional CNNs usually use the same set of filters for feature extraction, where labels play a less central role of the final performance, as label information is not better utilized. To solve the problem of how to represent label information better and how to apply the learned label representations to the text classification tasks, we propose an adaptive convolution with label embedding(ACLE) in this paper, which adaptively generated convolutional filters that are conditioned on inputs and made each label embedded in the same space with the word vectors. Our method maintains the flexibility of adaptive convolution, and fully extracts label information to play an auxiliary role. The experimental results on the several large text datasets show that the proposed model is feasible and out-performs the state-of-the-art methods by a large margin in terms of accuracy.
引用
收藏
页码:804 / 812
页数:9
相关论文
共 50 条
  • [1] An adaptive convolution with label embedding for text classification
    Changgeng Tan
    Yuan Ren
    Chen Wang
    Applied Intelligence, 2023, 53 : 804 - 812
  • [2] Adaptive Convolution for Text Classification
    Choi, Byung-Ju
    Park, Jun-Hyung
    Lee, SangKeun
    2019 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES (NAACL HLT 2019), VOL. 1, 2019, : 2475 - 2485
  • [3] Adaptive Region Embedding for Text Classification
    Xiang, Liuyu
    Jin, Xiaoming
    Yi, Lan
    Ding, Guiguang
    THIRTY-THIRD AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FIRST INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / NINTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, : 7314 - 7321
  • [4] Multi-Task Label Embedding for Text Classification
    Zhang, Honglun
    Xiao, Liqiang
    Chen, Wenqing
    Wang, Yongkun
    Jin, Yaohui
    2018 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2018), 2018, : 4545 - 4553
  • [5] Long Text Truncation Algorithm Based on Label Embedding in Text Classification
    Chen, Jingang
    Lv, Shu
    APPLIED SCIENCES-BASEL, 2022, 12 (19):
  • [6] Label-Embedding-Based Multi-core Convolution for Text Categorization
    Yuan, Guorui
    Li, Jun
    Li, Hongguang
    Du, Yang
    Li, Yongrui
    Yu, An
    2020 12TH INTERNATIONAL CONFERENCE ON ADVANCED COMPUTATIONAL INTELLIGENCE (ICACI), 2020, : 269 - 276
  • [7] Text Classification under Attention Mechanism Based on Label Embedding
    Yuan, Guorui
    Li, Jun
    Lan, Zixuan
    Shu, Wenjie
    Xu, Gaowu
    2021 PROCEEDINGS OF THE 40TH CHINESE CONTROL CONFERENCE (CCC), 2021, : 8261 - 8266
  • [8] GILE: A Generalized Input-Label Embedding for Text Classification
    Pappas, Nikolaos
    Henderson, James
    TRANSACTIONS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, 2019, 7 : 139 - 155
  • [9] Co-attention network with label embedding for text classification
    Liu, Minqian
    Liu, Lizhao
    Cao, Junyi
    Du, Qing
    NEUROCOMPUTING, 2022, 471 : 61 - 69
  • [10] Fusing Label Embedding into BERT: An Efficient Improvement for Text Classification
    Xiong, Yijin
    Feng, Yukun
    Wu, Hao
    Kamigaito, Hidetaka
    Okumura, Manabu
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, ACL-IJCNLP 2021, 2021, : 1743 - 1750