A Multimodal Sentiment Analysis Model Enhanced with Non-verbal Information and Contrastive Learning

被引:0
|
作者
Liu, Jia [1 ,2 ,3 ,4 ]
Song, Hong [1 ,2 ]
Chen, Dapeng [1 ,2 ,3 ,4 ]
Wang, Bin [1 ,2 ]
Zhang, Zengwei [1 ,2 ]
机构
[1] Tianchang Research Institute, Nanjing University of Information Science & Technology, Chuzhou,239300, China
[2] School of Automation, Nanjing University of Information Science & Technology, Nanjing,210044, China
[3] Jiangsu Province Engineering Research Center of Intelligent Meteorological Exploration Robot, Nanjing,210044, China
[4] Jiangsu Collaborative Innovation Center of Atmospheric Environment and Equipment Technology, Nanjing,210044, China
基金
中国国家自然科学基金;
关键词
D O I
10.11999/JEIT231274
中图分类号
学科分类号
摘要
引用
收藏
页码:3372 / 3381
相关论文
共 50 条
  • [1] MSA-HCL: MULTIMODAL SENTIMENT ANALYSIS MODEL WITH HYBRID CONTRASTIVE LEARNING
    Zhao, Wang
    Zhang, Yong
    Hua, Qiang
    Dong, Chun-ru
    Wang, Jia-nan
    Zhang, Feng
    MATHEMATICAL FOUNDATIONS OF COMPUTING, 2024,
  • [2] Aspect-Based Sentiment Analysis Model of Multimodal Collaborative Contrastive Learning
    Yu, Bengong
    Xing, Yu
    Zhang, Shuwen
    Data Analysis and Knowledge Discovery, 2024, 8 (11) : 22 - 32
  • [3] Leveraging Vision-Language Pre-Trained Model and Contrastive Learning for Enhanced Multimodal Sentiment Analysis
    An, Jieyu
    Zainon, Wan Mohd Nazmee Wan
    Ding, Binfen
    INTELLIGENT AUTOMATION AND SOFT COMPUTING, 2023, 37 (02): : 1673 - 1689
  • [4] Dynamic Weighted Multitask Learning and Contrastive Learning for Multimodal Sentiment Analysis
    Wang, Xingqi
    Zhang, Mengrui
    Chen, Bin
    Wei, Dan
    Shao, Yanli
    ELECTRONICS, 2023, 12 (13)
  • [5] Text-Centric Multimodal Contrastive Learning for Sentiment Analysis
    Peng, Heng
    Gu, Xue
    Li, Jian
    Wang, Zhaodan
    Xu, Hao
    ELECTRONICS, 2024, 13 (06)
  • [6] Analysis and synthesis of multimodal verbal and non-verbal interaction for animated interface agents
    Beskow, Jonas
    Granstrom, Bjorn
    House, David
    VERBAL AND NONVERBAL COMMUNICATION BEHAVIOURS, 2007, 4775 : 250 - +
  • [7] COMPARATIVE ANALYSIS OF VERBAL AND NON-VERBAL METHODS TO OBTAIN MANAGERIAL INFORMATION
    Lobanova, E. N.
    RUDN JOURNAL OF SOCIOLOGY-VESTNIK ROSSIISKOGO UNIVERSITETA DRUZHBY NARODOV SERIYA SOTSIOLOGIYA, 2013, (04): : 117 - 126
  • [8] THE COHERENCE OF VERBAL AND NON-VERBAL COMMUNICATION ELEMENTS IN THE POLITICAL TV TALK SHOWS: CONTRASTIVE ANALYSIS
    Poskiene, Audrone
    PSYCHOLOGY AND PSYCHIATRY, SOCIOLOGY AND HEALTHCARE, EDUCATION, VOL II, 2015, : 969 - 980
  • [9] Transformer-based adaptive contrastive learning for multimodal sentiment analysis
    Yifan Hu
    Xi Huang
    Xianbing Wang
    Hai Lin
    Rong Zhang
    Multimedia Tools and Applications, 2025, 84 (3) : 1385 - 1402
  • [10] Non-verbal learning disabilities: The syndrome and the model.
    Szatmari, P
    Morgan, J
    CANADIAN JOURNAL OF PSYCHIATRY-REVUE CANADIENNE DE PSYCHIATRIE, 1997, 42 (10): : 1081 - 1081