A Lightweight Image-Text Sentiment Analysis Model Based on Public Emotion Feature Compression and Fusion

被引：0
|
作者：
Gan, Chenquan [1 ]
Fu, Xiang [1 ]
Feng, Qingdong [1 ]
Zhu, Qingyi [2 ]
机构：
[1] School of Communication and Information Engineering, Chongqing University of Posts and Telecommunications, Chongqing,400065, China
[2] School of Cyber Security and Information Law, Chongqing University of Posts and Telecommunications, Chongqing,400065, China
来源：
Jisuanji Yanjiu yu Fazhan/Computer Research and Development | 2023年 / 60卷 / 05期
关键词：
Due to the combination of image and text can better reflect the users’ attitude and standpoint; image-text sentiment analysis has become a research hotspot. However; the existing sentiment analysis methods cannot extract and fuse image-text emotion information effectively; which results in low performance; large amount of parameters; and difficulty in deployment. In this paper; a lightweight image-text sentiment analysis model using public emotion feature compression and fusion is proposed. This model designs the image and text feature compression module by combining the convolution layer and fully connected layer to extract and compress the feature for reducing the feature dimension simultaneously. In addition; a public emotion feature fusion module based on the gating mechanism is proposed to eliminate the heterogeneity of image-text features through mapping the image and text features to the same emotional space and reduce the redundant information by extracting and fusing the public emotion features of image-text. Experimental results on 3 baseline datasets of Twitter; Flickr; and Getty Images show that the proposed model can extract and fuse the emotional information of image-text more effectively than the early models. Compared with the latest models; the proposed model greatly reduces model parameters and has better performance; and is easier to be deployed. © 2023 Science Press. All rights reserved;
D O I：
10.7544/issn1000-1239.202111218
中图分类号：
学科分类号：
摘要：
引用
收藏
页码：1099 / 1110
相关论文
共 50 条
  • [31] Image-Text Cross-Media Feature Correlation based on Adversarial Network
    Xia, Ying
    Tian, Gengquan
    [J]. PROCEEDINGS OF 2019 6TH IEEE INTERNATIONAL CONFERENCE ON CLOUD COMPUTING AND INTELLIGENCE SYSTEMS (CCIS), 2019, : 93 - 97
  • [32] A model for sentiment and emotion analysis of unstructured social media text
    Jitendra Kumar Rout
    Kim-Kwang Raymond Choo
    Amiya Kumar Dash
    Sambit Bakshi
    Sanjay Kumar Jena
    Karen L. Williams
    [J]. Electronic Commerce Research, 2018, 18 : 181 - 199
  • [33] A model for sentiment and emotion analysis of unstructured social media text
    Rout, Jitendra Kumar
    Choo, Kim-Kwang Raymond
    Dash, Amiya Kumar
    Bakshi, Sambit
    Jena, Sanjay Kumar
    Williams, Karen L.
    [J]. ELECTRONIC COMMERCE RESEARCH, 2018, 18 (01) : 181 - 199
  • [34] Fusion of Image-text attention for Transformer-based Multimodal Machine Translation
    Ma, Junteng
    Qin, Shihao
    Su, Lan
    Li, Xia
    Xiao, Lixian
    [J]. PROCEEDINGS OF THE 2019 INTERNATIONAL CONFERENCE ON ASIAN LANGUAGE PROCESSING (IALP), 2019, : 199 - 204
  • [35] Text-guided floral image generation based on lightweight deep attention feature fusion GAN
    Yang, Wenji
    An, Hang
    Hu, Wenchao
    Ma, Xinxin
    Xie, Liping
    [J]. VISUAL COMPUTER, 2024,
  • [36] Movie Short-Text Reviews Sentiment Analysis Based on Multi-Feature Fusion
    Zhang, Shangqian
    Lvt, Xueqiang
    Tang, Yunzhong
    Dong, Zhian
    [J]. 2018 INTERNATIONAL CONFERENCE ON ALGORITHMS, COMPUTING AND ARTIFICIAL INTELLIGENCE (ACAI 2018), 2018,
  • [37] Multimodal Fake News Analysis Based on Image-Text Similarity
    Zhang, Xichen
    Dadkhah, Sajjad
    Weismann, Alexander Gerald
    Kanaani, Mohammad Amin
    Ghorbani, Ali A.
    [J]. IEEE TRANSACTIONS ON COMPUTATIONAL SOCIAL SYSTEMS, 2024, 11 (01) : 959 - 972
  • [38] Development of a Lightweight Crop Disease Image Identification Model Based on Attentional Feature Fusion
    Cheng, Zekai
    Liu, Meifang
    Qian, Rong
    Huang, Rongqing
    Dong, Wei
    [J]. SENSORS, 2022, 22 (15)
  • [39] Image-Text Sentiment Analysis Via Context Guided Adaptive Fine-Tuning Transformer
    Xiao, Xingwang
    Pu, Yuanyuan
    Zhao, Zhengpeng
    Nie, Rencan
    Xu, Dan
    Qian, Wenhua
    Wu, Hao
    [J]. NEURAL PROCESSING LETTERS, 2023, 55 (03) : 2103 - 2125
  • [40] Vector based sentiment and emotion analysis from text: A survey
    Aka Uymaz, Hande
    Kumova Metin, Senem
    [J]. ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2022, 113
12345