A multi-label social short text classification method based on contrastive learning and improved ml-KNN

被引:2
|
作者
Tian, Gang [1 ]
Wang, Jiachang [1 ]
Wang, Rui [2 ]
Zhao, Guangxin [1 ]
He, Cheng [1 ]
机构
[1] Shandong Univ Sci & Technol, Coll Comp Sci & Engn, Qingdao, Peoples R China
[2] Shandong Univ Sci & Technol, Coll Energy & Min Engn, Qingdao, Peoples R China
关键词
contrastive learning; deep learning; improved ml-KNN; multi-label text classification;
D O I
10.1111/exsy.13547
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Short texts on social platforms often have the problems of diverse categories and semantic sparsity, making it challenging to identify the diverse intentions of users. To address this issue, this article proposes a multi-label social short text classification method (IML-CL) based on contrastive learning and improved ml-KNN. First, a contrastive learning approach is employed to train a multi-label text classification model. This approach improves semantic sparsity by leveraging the knowledge from the existing samples to enrich the feature representation of short texts. Simultaneously, an improved ml-KNN algorithm is developed to enhance the accuracy of label prediction. This algorithm utilizes a two-layer nearest neighbor rule and introduces a penalty function and weight optimization. Next, the model generates the feature representation for the test sample and predicts its label. Additionally, the improved ml-KNN algorithm retrieves neighbors of the test sample and uses their label information for prediction. Finally, the two predictions are combined to obtain the final prediction, which accurately identifies the user's intention. The experimental results demonstrate that, on the dataset constructed in this article, the IML-CL method effectively boosts the performance of the baseline model.
引用
收藏
页数:19
相关论文
共 50 条
  • [1] An Improved ML-kNN Multi-label Classification Model Based on Feature Dimensionality Reduction
    Li, Zhi-qiang
    Cao, Shuai-yi
    Guo, Hong-chen
    INTERNATIONAL CONFERENCE ON COMPUTER, MECHATRONICS AND ELECTRONIC ENGINEERING (CMEE 2016), 2016,
  • [2] A classification algorithm based on weighted ML-kNN for multi-label data
    Jiang M.
    Du L.
    Wu J.
    Zhang M.
    Gong Z.
    Int. J. Internet Manuf. Serv., 2019, 4 (326-342): : 326 - 342
  • [3] Research on multi-label user classification of social media based on ML-KNN algorithm
    Huang, Anzhong
    Xu, Rui
    Chen, Yu
    Guo, Meiwen
    TECHNOLOGICAL FORECASTING AND SOCIAL CHANGE, 2023, 188
  • [4] Hierarchical text classification with multi-label contrastive learning and KNN
    Zhang, Jun
    Li, Yubin
    Shen, Fanfan
    He, Yueshun
    Tan, Hai
    He, Yanxiang
    NEUROCOMPUTING, 2024, 577
  • [5] ML-KNN: A lazy learning approach to multi-label leaming
    Zhang, Min-Ling
    Zhou, Zhi-Hua
    PATTERN RECOGNITION, 2007, 40 (07) : 2038 - 2048
  • [6] Multi-label Classification of Twitter Data Using Modified ML-KNN
    Srivastava, Saurabh Kumar
    Singh, Sandeep Kumar
    ADVANCES IN DATA AND INFORMATION SCIENCES, ICDIS 2017, VOL 2, 2019, 39 : 31 - 41
  • [7] Multi-Label Text Classification Based on Contrastive and Correlation Learning
    Yang, Shuo
    Gao, Shu
    PROCEEDINGS OF 2024 3RD INTERNATIONAL CONFERENCE ON CYBER SECURITY, ARTIFICIAL INTELLIGENCE AND DIGITAL ECONOMY, CSAIDE 2024, 2024, : 325 - 330
  • [8] An Adaptation of the ML-kNN Algorithm to Predict the Number of Classes in Hierarchical Multi-label Classification
    Almeida, Thissiany Beatriz
    Borges, Helyane Bronoski
    MODELING DECISIONS FOR ARTIFICIAL INTELLIGENCE (MDAI 2017), 2017, 10571 : 77 - 88
  • [9] Multi-Label Code Error Classification Using CodeT5 and ML-KNN
    Amin, Md Faizul Ibne
    Shirafuji, Atsushi
    Rahman, Md Mostafizer
    Watanobe, Yutaka
    IEEE ACCESS, 2024, 12 : 100805 - 100820
  • [10] Contrastive Enhanced Learning for Multi-Label Text Classification
    Wu, Tianxiang
    Yang, Shuqun
    APPLIED SCIENCES-BASEL, 2024, 14 (19):