Multi-Label Text Classification Based on Contrastive and Correlation Learning

被引:0
|
作者
Yang, Shuo [1 ]
Gao, Shu [1 ]
机构
[1] Wuhan Univ Technol, Sch Comp Sci & Artificial Intelligence, Wuhan 430070, Hubei, Peoples R China
基金
中国国家自然科学基金;
关键词
multi-label text classification; label correlation; contrastive learning; graph attention mechanism; label semantics;
D O I
10.1145/3672919.3672979
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Multi-label text classification plays a crucial role in various domains. However, accurately capturing complex inter-label relationships and delving into the semantic information between labels and text remains a challenging problem. Therefore, we propose a multi-label text classification method based on contrastive and correlation learning. By introducing contrastive learning into multi-label text classification tasks, it enhances the distinctiveness and expressiveness of text and label features. In the extraction of label features, external knowledge from Wikipedia is incorporated and various embedding methods are employed to extract label information, enabling a deeper exploration of label semantics. Meanwhile, GAT is used to more accurately extract inter-label correlations. In the prediction module, an improved label correlation network is introduced to further consider label relevance. Experimental results demonstrate the feasibility and effectiveness of the proposed method on two publicly available datasets, AAPD and RCV1. Compared to state-of-the-art models, our method achieves a 0.5%-1.5% improvement in micro-F1 metrics, validating the efficacy of the approach.
引用
收藏
页码:325 / 330
页数:6
相关论文
共 50 条
  • [1] Contrastive Enhanced Learning for Multi-Label Text Classification
    Wu, Tianxiang
    Yang, Shuqun
    [J]. APPLIED SCIENCES-BASEL, 2024, 14 (19):
  • [2] Hierarchical text classification with multi-label contrastive learning and KNN
    Zhang, Jun
    Li, Yubin
    Shen, Fanfan
    He, Yueshun
    Tan, Hai
    He, Yanxiang
    [J]. NEUROCOMPUTING, 2024, 577
  • [3] Exploring Contrastive Learning for Long-Tailed Multi-label Text Classification
    Audibert, Alexandre
    Gauffre, Aurelien
    Amini, Massih-Reza
    [J]. MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES: RESEARCH TRACK, PT VII, ECML PKDD 2024, 2024, 14947 : 245 - 261
  • [4] Multi-label text classification based on the label correlation mixture model
    He, Zhiyang
    Wu, Ji
    Lv, Ping
    [J]. INTELLIGENT DATA ANALYSIS, 2017, 21 (06) : 1371 - 1392
  • [5] Contrastive Learning-Enhanced Nearest Neighbor Mechanism for Multi-Label Text Classification
    Su, Xi'ao
    Wang, Ran
    Dai, Xinyu
    [J]. PROCEEDINGS OF THE 60TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2022): (SHORT PAPERS), VOL 2, 2022, : 672 - 679
  • [6] Label Correlation Based Graph Convolutional Network for Multi-label Text Classification
    Huy-The Vu
    Minh-Tien Nguyen
    Van-Chien Nguyen
    Manh-Tran Tien
    Van-Hau Nguyen
    [J]. 2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [7] A Survey of Multi-label Text Classification Based on Deep Learning
    Chen, Xiaolong
    Cheng, Jieren
    Liu, Jingxin
    Xu, Wenghang
    Hua, Shuai
    Tang, Zhu
    Sheng, Victor S.
    [J]. ARTIFICIAL INTELLIGENCE AND SECURITY, ICAIS 2022, PT I, 2022, 13338 : 443 - 456
  • [8] Multi-Label Arabic Text Classification Based On Deep Learning
    Alsukhni, Batool
    [J]. 2021 12TH INTERNATIONAL CONFERENCE ON INFORMATION AND COMMUNICATION SYSTEMS (ICICS), 2021, : 475 - 477
  • [9] Multi-label text classification via joint learning from label embedding and label correlation
    Liu, Huiting
    Chen, Geng
    Li, Peipei
    Zhao, Peng
    Wu, Xindong
    [J]. NEUROCOMPUTING, 2021, 460 : 385 - 398
  • [10] Correlation Networks for Extreme Multi-label Text Classification
    Xun, Guangxu
    Jha, Kishlay
    Sun, Jianhui
    Zhang, Aidong
    [J]. KDD '20: PROCEEDINGS OF THE 26TH ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2020, : 1074 - 1082