An adaptive convolution with label embedding for text classification

被引:5
|
作者
Tan, Changgeng [1 ]
Ren, Yuan [1 ]
Wang, Chen [1 ]
机构
[1] Cent South Univ, Changsha, Hunan, Peoples R China
关键词
Text classification; Label embedding; CNN; Adaptive filters;
D O I
10.1007/s10489-021-02702-x
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Convolutional neural network (CNNs) has made a breakthrough since deep learning was employed to text classification. However, the traditional CNNs usually use the same set of filters for feature extraction, where labels play a less central role of the final performance, as label information is not better utilized. To solve the problem of how to represent label information better and how to apply the learned label representations to the text classification tasks, we propose an adaptive convolution with label embedding(ACLE) in this paper, which adaptively generated convolutional filters that are conditioned on inputs and made each label embedded in the same space with the word vectors. Our method maintains the flexibility of adaptive convolution, and fully extracts label information to play an auxiliary role. The experimental results on the several large text datasets show that the proposed model is feasible and out-performs the state-of-the-art methods by a large margin in terms of accuracy.
引用
收藏
页码:804 / 812
页数:9
相关论文
共 50 条
  • [41] Hierarchical Label Generation for Text Classification
    Kwon, Jingun
    Kamigaito, Hidetaka
    Song, Young-In
    Okumura, Manabu
    17TH CONFERENCE OF THE EUROPEAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, EACL 2023, 2023, : 625 - 632
  • [42] Learning label smoothing for text classification
    Ren H.
    Zhao Y.
    Zhang Y.
    Sun W.
    PeerJ Computer Science, 2024, 10
  • [43] Learning label smoothing for text classification
    Ren, Han
    Zhao, Yajie
    Zhang, Yong
    Sun, Wei
    PEERJ COMPUTER SCIENCE, 2024, 10
  • [44] Hierarchical Label Text Classification Method with Deep Label Assisted Classification Task
    Yukun, Cao
    Ziyue, Wei
    Yijia, Tang
    Chengkun, Jin
    Yunfeng, Li
    Computer Engineering and Applications, 2024, 60 (10) : 105 - 112
  • [45] Rethinking of BERT sentence embedding for text classification
    Omar Galal
    Ahmed H. Abdel-Gawad
    Mona Farouk
    Neural Computing and Applications, 2024, 36 (32) : 20245 - 20258
  • [46] Graph ConvolutionWord Embedding and Attention for Text Classification
    Yang, Yi
    Cui, Qihui
    Ji, Lijun
    Cheng, Zhuoran
    PROCEEDINGS OF 2022 THE 6TH INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND SOFT COMPUTING, ICMLSC 20222, 2022, : 160 - 166
  • [47] Joint Embedding of Words and Labels for Text Classification
    Wang, Guoyin
    Li, Chunyuan
    Wang, Wenlin
    Zhang, Yizhe
    Shen, Dinghan
    Zhang, Xinyuan
    Henao, Ricardo
    Carin, Lawrence
    PROCEEDINGS OF THE 56TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL), VOL 1, 2018, : 2321 - 2331
  • [48] A Weighted Word Embedding Model for Text Classification
    Ren, Haopeng
    Zeng, ZeQuan
    Cai, Yi
    Du, Qing
    Li, Qing
    Xie, Haoran
    DATABASE SYSTEMS FOR ADVANCED APPLICATIONS (DASFAA 2019), PT I, 2019, 11446 : 419 - 434
  • [49] Label Embedding for Multi-label Classification Via Dependence Maximization
    Li, Yachong
    Yang, Youlong
    NEURAL PROCESSING LETTERS, 2020, 52 (02) : 1651 - 1674
  • [50] Cost-sensitive label embedding for multi-label classification
    Huang, Kuan-Hao
    Lin, Hsuan-Tien
    MACHINE LEARNING, 2017, 106 (9-10) : 1725 - 1746