Multi-Task Learning for Sentiment Analysis with Hard-Sharing and Task Recognition Mechanisms

被引:15
|
作者
Zhang, Jian [1 ]
Yan, Ke [1 ,2 ]
Mo, Yuchang [3 ]
机构
[1] China Jiliang Univ, Coll Informat Engn, Key Lab Electromagnet Wave Informat Technol & Met, Hangzhou 310018, Peoples R China
[2] Natl Univ Singapore, 4 Architecture Dr, Singapore 117566, Singapore
[3] Huaqiao Univ, Fujian Prov Univ Key Lab Computat Sci, Sch Math Sci, Quanzhou 362021, Peoples R China
基金
中国国家自然科学基金;
关键词
text classification; multi-task learning; hard-sharing mechanism; task recognition mechanism;
D O I
10.3390/info12050207
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In the era of big data, multi-task learning has become one of the crucial technologies for sentiment analysis and classification. Most of the existing multi-task learning models for sentiment analysis are developed based on the soft-sharing mechanism that has less interference between different tasks than the hard-sharing mechanism. However, there are also fewer essential features that the model can extract with the soft-sharing method, resulting in unsatisfactory classification performance. In this paper, we propose a multi-task learning framework based on a hard-sharing mechanism for sentiment analysis in various fields. The hard-sharing mechanism is achieved by a shared layer to build the interrelationship among multiple tasks. Then, we design a task recognition mechanism to reduce the interference of the hard-shared feature space and also to enhance the correlation between multiple tasks. Experiments on two real-world sentiment classification datasets show that our approach achieves the best results and improves the classification accuracy over the existing methods significantly. The task recognition training process enables a unique representation of the features of different tasks in the shared feature space, providing a new solution reducing interference in the shared feature space for sentiment analysis.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] Multimodal Sentiment Recognition With Multi-Task Learning
    Zhang, Sun
    Yin, Chunyong
    Yin, Zhichao
    [J]. IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2023, 7 (01): : 200 - 209
  • [2] Multi-task Learning for Multi-modal Emotion Recognition and Sentiment Analysis
    Akhtar, Md Shad
    Chauhan, Dushyant Singh
    Ghosal, Deepanway
    Poria, Soujanya
    Ekbal, Asif
    Bhattacharyya, Pushpak
    [J]. 2019 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES (NAACL HLT 2019), VOL. 1, 2019, : 370 - 379
  • [3] Improving sentiment analysis with multi-task learning of negation
    Barnes, Jeremy
    Velldal, Erik
    Ovrelid, Lilja
    [J]. NATURAL LANGUAGE ENGINEERING, 2021, 27 (02) : 249 - 269
  • [4] Task Adaptive Parameter Sharing for Multi-Task Learning
    Wallingford, Matthew
    Li, Hao
    Achille, Alessandro
    Ravichandran, Avinash
    Fowlkes, Charless
    Bhotika, Rahul
    Soatto, Stefano
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 7551 - 7560
  • [5] Fitting and sharing multi-task learning
    Piao, Chengkai
    Wei, Jinmao
    [J]. APPLIED INTELLIGENCE, 2024, 54 (9-10) : 6918 - 6929
  • [6] Imbalanced Sentiment Classification with Multi-Task Learning
    Wu, Fangzhao
    Wu, Chuhan
    Liu, Junxin
    [J]. CIKM'18: PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, 2018, : 1631 - 1634
  • [7] Multi-task Learning for Automated Essay Scoring with Sentiment Analysis
    Muangkammuen, Panitan
    Fukumoto, Fumiyo
    [J]. AACL-IJCNLP 2020: THE 1ST CONFERENCE OF THE ASIA-PACIFIC CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS AND THE 10TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING: PROCEEDINGS OF THE STUDENT RESEARCH WORKSHOP, 2020, : 109 - 116
  • [8] Adaptive Hard Parameter Sharing Method Based on Multi-Task Deep Learning
    Wang, Hongxia
    Jin, Xiao
    Du, Yukun
    Zhang, Nan
    Hao, Hongxia
    [J]. MATHEMATICS, 2023, 11 (22)
  • [9] A text guided multi-task learning network for multimodal sentiment analysis
    Luo, Yuanyi
    Wu, Rui
    Liu, Jiafeng
    Tang, Xianglong
    [J]. NEUROCOMPUTING, 2023, 560
  • [10] A Multi-Task Learning Approach to Improve Sentiment Analysis with Explicit Recommendation
    Habimana, Olivier
    Li, Yuhua
    Li, Ruixuan
    Gu, Xiwu
    Peng, Yuqi
    [J]. 2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,