An adaptive convolution with label embedding for text classification

被引:5
|
作者
Tan, Changgeng [1 ]
Ren, Yuan [1 ]
Wang, Chen [1 ]
机构
[1] Cent South Univ, Changsha, Hunan, Peoples R China
关键词
Text classification; Label embedding; CNN; Adaptive filters;
D O I
10.1007/s10489-021-02702-x
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Convolutional neural network (CNNs) has made a breakthrough since deep learning was employed to text classification. However, the traditional CNNs usually use the same set of filters for feature extraction, where labels play a less central role of the final performance, as label information is not better utilized. To solve the problem of how to represent label information better and how to apply the learned label representations to the text classification tasks, we propose an adaptive convolution with label embedding(ACLE) in this paper, which adaptively generated convolutional filters that are conditioned on inputs and made each label embedded in the same space with the word vectors. Our method maintains the flexibility of adaptive convolution, and fully extracts label information to play an auxiliary role. The experimental results on the several large text datasets show that the proposed model is feasible and out-performs the state-of-the-art methods by a large margin in terms of accuracy.
引用
收藏
页码:804 / 812
页数:9
相关论文
共 50 条
  • [21] Label-Embedding Bi-directional Attentive Model for Multi-label Text Classification
    Liu, Naiyin
    Wang, Qianlong
    Ren, Jiangtao
    NEURAL PROCESSING LETTERS, 2021, 53 (01) : 375 - 389
  • [22] Label-Embedding Bi-directional Attentive Model for Multi-label Text Classification
    Naiyin Liu
    Qianlong Wang
    Jiangtao Ren
    Neural Processing Letters, 2021, 53 : 375 - 389
  • [23] Semantic-Unit-Based Dilated Convolution for Multi-Label Text Classification
    Lin, Junyang
    Su, Qi
    Yang, Pengcheng
    Ma, Shuming
    Sun, Xu
    2018 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2018), 2018, : 4554 - 4564
  • [24] Adaptive Convolution Kernel for Text Classification via Multi-channel Representations
    Wang, Cheng
    Fan, Xiaoyan
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2020, PT II, 2020, 12397 : 708 - 720
  • [25] Concept-Based Label Embedding via Dynamic Routing for Hierarchical Text Classification
    Wang, Xuepeng
    Zhao, Li
    Liu, Bing
    Chen, Tao
    Zhang, Feng
    Wang, Di
    59TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS AND THE 11TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING (ACL-IJCNLP 2021), VOL 1, 2021, : 5010 - 5019
  • [26] Improve label embedding quality through global sensitive GAT for hierarchical text classification
    Liu, Hankai
    Huang, Xianying
    Liu, Xiaoyang
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 238
  • [27] A Multi-Task Text Classification Model Based on Label Embedding of Attention Mechanism
    Yuemei X.
    Zuwei F.
    Han C.
    Data Analysis and Knowledge Discovery, 2022, 6 (2-3): : 105 - 116
  • [28] Label Embedding: A Frugal Baseline for Text Recognition
    Rodriguez-Serrano, Jose A.
    Gordo, Albert
    Perronnin, Florent
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2015, 113 (03) : 193 - 207
  • [29] Label Embedding: A Frugal Baseline for Text Recognition
    Jose A. Rodriguez-Serrano
    Albert Gordo
    Florent Perronnin
    International Journal of Computer Vision, 2015, 113 : 193 - 207
  • [30] Label-Embedding for Image Classification
    Akata, Zeynep
    Perronnin, Florent
    Harchaoui, Zaid
    Schmid, Cordelia
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2016, 38 (07) : 1425 - 1438