A Multimodal Sentiment Analysis Model Enhanced with Non-verbal Information and Contrastive Learning

被引：0
|
作者：
Liu, Jia [1 ,2 ,3 ,4 ]
Song, Hong [1 ,2 ]
Chen, Dapeng [1 ,2 ,3 ,4 ]
Wang, Bin [1 ,2 ]
Zhang, Zengwei [1 ,2 ]
机构：
[1] Tianchang Research Institute, Nanjing University of Information Science & Technology, Chuzhou,239300, China
[2] School of Automation, Nanjing University of Information Science & Technology, Nanjing,210044, China
[3] Jiangsu Province Engineering Research Center of Intelligent Meteorological Exploration Robot, Nanjing,210044, China
[4] Jiangsu Collaborative Innovation Center of Atmospheric Environment and Equipment Technology, Nanjing,210044, China
来源：
Dianzi Yu Xinxi Xuebao/Journal of Electronics and Information Technology | 2024年 / 46卷 / 08期
基金：
中国国家自然科学基金;
关键词：
D O I：
10.11999/JEIT231274
中图分类号：
学科分类号：
摘要：
引用
收藏
页码：3372 / 3381
相关论文
共 50 条
  • [21] Hierarchical Fusion Network with Enhanced Knowledge and Contrastive Learning for Multimodal Aspect-Based Sentiment Analysis on Social Media
    Hu, Xiaoran
    Yamamura, Masayuki
    SENSORS, 2023, 23 (17)
  • [22] Modality effects in immediate recall of verbal and non-verbal information
    deGelder, B
    Vroomen, J
    EUROPEAN JOURNAL OF COGNITIVE PSYCHOLOGY, 1997, 9 (01): : 97 - 110
  • [23] Cross-modal contrastive learning for multimodal sentiment recognition
    Yang, Shanliang
    Cui, Lichao
    Wang, Lei
    Wang, Tao
    APPLIED INTELLIGENCE, 2024, 54 (05) : 4260 - 4276
  • [24] Cross-modal contrastive learning for multimodal sentiment recognition
    Shanliang Yang
    Lichao Cui
    Lei Wang
    Tao Wang
    Applied Intelligence, 2024, 54 : 4260 - 4276
  • [25] ConFEDE: Contrastive Feature Decomposition for Multimodal Sentiment Analysis
    Yang, Jiuding
    Yu, Yakun
    Niu, Di
    Guo, Weidong
    Xu, Yu
    PROCEEDINGS OF THE 61ST ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, ACL 2023, VOL 1, 2023, : 7617 - 7630
  • [26] Construction of Automatic Speech Recognition Model that Recognizes Linguistic Information and Verbal/Non-verbal Phenomena
    Shione, Nagito
    Wakabayashi, Yukoh
    Kitaoka, Norihide
    2023 ASIA PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE, APSIPA ASC, 2023, : 2306 - 2311
  • [27] MOCOLNet: A Momentum Contrastive Learning Network for Multimodal Aspect-Level Sentiment Analysis
    Mu J.
    Nie F.
    Wang W.
    Xu J.
    Zhang J.
    Liu H.
    IEEE Transactions on Knowledge and Data Engineering, 2024, 36 (12) : 1 - 14
  • [28] Verbal and Non-verbal Communicationin Game-Based-Learning
    Popescu, Maria Magdalena
    PROCEEDINGS OF THE 9TH INTERNATIONAL CONFERENCE ON VIRTUAL LEARNING, 2014, : 136 - 144
  • [29] Verbal and Non-verbal Markers for the Analysis of Political Discourse
    Pelosi, Serena
    Trotta, Daniela
    Maisto, Alessandro
    2019 SIXTH INTERNATIONAL CONFERENCE ON SOCIAL NETWORKS ANALYSIS, MANAGEMENT AND SECURITY (SNAMS), 2019, : 435 - 440
  • [30] Influence of Visual Non-verbal Information on Information Transmission to Audience
    Tatsumi, Akihiro
    Seki, Kazuyuki
    Okubo, Masashi
    ADVANCES IN AFFECTIVE AND PLEASURABLE DESIGN, 2020, 952 : 86 - 94
12345