BLR: A Multi-modal Sentiment Analysis Model

被引:0
|
作者
Yang Yang [1 ,2 ,3 ,4 ]
Ye Zhonglin [1 ,2 ,3 ,4 ]
Zhao Haixing [1 ,2 ,3 ,4 ]
Li Gege [1 ,2 ,3 ,4 ]
Cao Shujuan [1 ,2 ,3 ,4 ]
机构
[1] Qinghai Normal Univ, Coll Comp, Xining 810008, Peoples R China
[2] State Key Lab Tibetan Intelligent Informat Proc &, Xining 810008, Peoples R China
[3] Tibetan Informat Proc & Machine Translat Key Lab, Xining 810008, Peoples R China
[4] Minist Educ, Key Lab Tibetan Informat Proc, Xining 810008, Peoples R China
关键词
Transformer; Deep Learning; Multi-modal; Feature Fusion;
D O I
10.1007/978-3-031-44204-9_39
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In multi-modal sentiment analysis tasks, deep learning plays an important role due to its excellent performance. Compared with the traditional statistical approaches and machine learning approaches, deep learning methods have better performance and stability. However, there are still two problems in multi-modal sentiment analysis works, one is that the fused features lead to missing important information. Another is that the affiliation of each feature after fusion is not precisely defined and calculated. To deal with issues, we propose a BLR Multi-channel dual FusionModel based on Bert,Lstm and ResNeST framework. Our model first ensures that the important features will not be lost after fusion to the maximum extent and then will be processed and optimized according to the contribution of each feature for the fusion. Finally, we conduct experiments on two datasets, the results show that the accuracy of our model gets 76.125% and 77.5%, growing 3.025% and 2.875% over the best baseline model, respectively. Thus, the proposed model BLR model, achieves better effectiveness in multi-modal sentiment analysis tasks.
引用
收藏
页码:466 / 478
页数:13
相关论文
共 50 条
  • [1] A Hierarchical Correlation Model for Multi-modal Sentiment Analysis on Social Media
    Lin, Dazhen
    Li, Lingxiao
    Cao, Donglin
    Li, Shaozi
    [J]. 12TH CHINESE CONFERENCE ON COMPUTER SUPPORTED COOPERATIVE WORK AND SOCIAL COMPUTING (CHINESECSCW 2017), 2017, : 41 - 47
  • [2] Multi-task & Multi-modal Sentiment Analysis Model Based on Aware Fusion
    Wu, Sisi
    Ma, Jing
    [J]. Data Analysis and Knowledge Discovery, 2023, 7 (10): : 74 - 84
  • [3] Multi-modal fusion attention sentiment analysis for mixed sentiment classification
    Xue, Zhuanglin
    Xu, Jiabin
    [J]. COGNITIVE COMPUTATION AND SYSTEMS, 2024,
  • [4] Toward's Arabic Multi-modal Sentiment Analysis
    Alqarafi, Abdulrahman S.
    Adeel, Ahsan
    Gogate, Mandar
    Dashitpour, Kia
    Hussain, Amir
    Durrani, Tariq
    [J]. COMMUNICATIONS, SIGNAL PROCESSING, AND SYSTEMS, 2019, 463 : 2378 - 2386
  • [5] Contextual Inter-modal Attention for Multi-modal Sentiment Analysis
    Ghosal, Deepanway
    Akhtar, Md Shad
    Chauhan, Dushyant
    Poria, Soujanya
    Ekbalt, Asif
    Bhattacharyyat, Pushpak
    [J]. 2018 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2018), 2018, : 3454 - 3466
  • [6] Mixture of Attention Variants for Modal Fusion in Multi-Modal Sentiment Analysis
    He, Chao
    Zhang, Xinghua
    Song, Dongqing
    Shen, Yingshan
    Mao, Chengjie
    Wen, Huosheng
    Zhu, Dingju
    Cai, Lihua
    [J]. BIG DATA AND COGNITIVE COMPUTING, 2024, 8 (02)
  • [7] Sequential Late Fusion Technique for Multi-modal Sentiment Analysis
    Banerjee, Debapriya
    Lygerakis, Fotios
    Makedon, Fillia
    [J]. THE 14TH ACM INTERNATIONAL CONFERENCE ON PERVASIVE TECHNOLOGIES RELATED TO ASSISTIVE ENVIRONMENTS, PETRA 2021, 2021, : 264 - 265
  • [8] Multi-Modal Sentiment Analysis Based on Interactive Attention Mechanism
    Wu, Jun
    Zhu, Tianliang
    Zheng, Xinli
    Wang, Chunzhi
    [J]. APPLIED SCIENCES-BASEL, 2022, 12 (16):
  • [9] Multi-modal Sentiment Analysis using Deep Canonical Correlation Analysis
    Sun, Zhongkai
    Sarma, Prathusha K.
    Sethares, William
    Bucy, Erik P.
    [J]. INTERSPEECH 2019, 2019, : 1323 - 1327
  • [10] Multi-modal Sentiment and Emotion Joint Analysis with a Deep Attentive Multi-task Learning Model
    Zhang, Yazhou
    Rong, Lu
    Li, Xiang
    Chen, Rui
    [J]. ADVANCES IN INFORMATION RETRIEVAL, PT I, 2022, 13185 : 518 - 532