Emotion Intensity Detection in Online Media: An Attention Mechanism Based Multimodal Deep Learning Approach

被引:0
|
作者
Chai, Yuanchen [1 ]
机构
[1] Sunshine Ruizhi Secur Consulting Beijing Co LTD, Beijing 100081, Peoples R China
来源
TEHNICKI VJESNIK-TECHNICAL GAZETTE | 2024年 / 31卷 / 02期
关键词
attention mechanism; emotion detection; multimodal; online media; NETWORK;
D O I
10.17559/TV-20230628001154
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
With the increasing influence of online public opinion, mining opinions and trend analysis from massive data of online media is important for understanding user sentiment, managing brand reputation, analyzing public opinion and optimizing marketing strategies. By combining data from multiple perceptual modalities, more comprehensive and accurate sentiment analysis results can be obtained. However, using multimodal data for sentiment analysis may face challenges such as data fusion, modal imbalance and inter -modal correlation. To overcome these challenges, the paper introduces an attention mechanism to multimodal sentiment analysis by constructing text, image, and audio feature extractors and using a custom cross -modal attention layer to compute the attention weights between different modalities, and finally fusing the attention -weighted features for sentiment classification. Through the cross -modal attention mechanism, the model can automatically learn the correlation between different modalities, dynamically adjust the modal weights, and selectively fuse features from different modalities, thus improving the accuracy and expressiveness of sentiment analysis.
引用
收藏
页码:587 / 595
页数:9
相关论文
共 50 条
  • [1] Multimodal Deep Learning for Social Media Popularity Prediction With Attention Mechanism
    Xu, Kele
    Lin, Zhimin
    Zhao, Jianqiao
    Shi, Peicang
    Deng, Wei
    Wang, Huaimin
    MM '20: PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, 2020, : 4580 - 4584
  • [2] A multimodal fusion emotion recognition method based on multitask learning and attention mechanism
    Xie, Jinbao
    Wang, Jiyu
    Wang, Qingyan
    Yang, Dali
    Gu, Jinming
    Tang, Yongqiang
    Varatnitski, Yury I.
    NEUROCOMPUTING, 2023, 556
  • [3] Multimodal emotion detection of tennis players based on deep reinforcement learning
    Wu, Wenjia
    INTERNATIONAL JOURNAL OF BIOMETRICS, 2024, 16 (05) : 497 - 513
  • [4] A deep learning approach for the depression detection of social media data with hybrid feature selection and attention mechanism
    Bhuvaneswari, M.
    Prabha, V. Lakshmi
    EXPERT SYSTEMS, 2023, 40 (09)
  • [5] Deep Collaborative Online Learning Resource Recommendation Based on Attention Mechanism
    Hao, Cuiping
    Yang, Ting
    SCIENTIFIC PROGRAMMING, 2022, 2022
  • [6] Music Emotion Classification Method Based on Deep Learning and Improved Attention Mechanism
    Jia, Xiaoguang
    COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2022, 2022
  • [7] Deep Learning Based Approach of Emotion Detection and Grading System
    Pattern Recognition and Image Analysis, 2020, 30 : 726 - 740
  • [8] Deep Learning Based Approach of Emotion Detection and Grading System
    Sonawane, Bhakti
    Sharma, Priyanka
    PATTERN RECOGNITION AND IMAGE ANALYSIS, 2020, 30 (04) : 726 - 740
  • [9] Pavement Crack Detection with Deep Learning Based on Attention Mechanism
    Cao J.
    Yang G.
    Yang X.
    1600, Institute of Computing Technology (32): : 1324 - 1333
  • [10] Multimodal Sarcasm Detection: A Deep Learning Approach
    Bharti, Santosh Kumar
    Gupta, Rajeev Kumar
    Shukla, Prashant Kumar
    Hatamleh, Wesam Atef
    Tarazi, Hussam
    Nuagah, Stephen Jeswinde
    WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2022, 2022