A Multimodal Sentiment Analysis Model Enhanced with Non-verbal Information and Contrastive Learning

被引：0
|
作者：
Liu, Jia [1 ,2 ,3 ,4 ]
Song, Hong [1 ,2 ]
Chen, Dapeng [1 ,2 ,3 ,4 ]
Wang, Bin [1 ,2 ]
Zhang, Zengwei [1 ,2 ]
机构：
[1] Tianchang Research Institute, Nanjing University of Information Science & Technology, Chuzhou,239300, China
[2] School of Automation, Nanjing University of Information Science & Technology, Nanjing,210044, China
[3] Jiangsu Province Engineering Research Center of Intelligent Meteorological Exploration Robot, Nanjing,210044, China
[4] Jiangsu Collaborative Innovation Center of Atmospheric Environment and Equipment Technology, Nanjing,210044, China
来源：
Dianzi Yu Xinxi Xuebao/Journal of Electronics and Information Technology | 2024年 / 46卷 / 08期
基金：
中国国家自然科学基金;
关键词：
D O I：
10.11999/JEIT231274
中图分类号：
学科分类号：
摘要：
引用
收藏
页码：3372 / 3381
相关论文
共 50 条
  • [41] Network structure underlying resolution of conflicting non-verbal and verbal social information
    Watanabe, Takamitsu
    Yahata, Noriaki
    Kawakubo, Yuki
    Inoue, Hideyuki
    Takano, Yosuke
    Iwashiro, Norichika
    Natsubori, Tatsunobu
    Takao, Hidemasa
    Sasaki, Hiroki
    Gonoi, Wataru
    Murakami, Mizuho
    Katsura, Masaki
    Kunimatsu, Akira
    Abe, Osamu
    Kasai, Kiyoto
    Yamasue, Hidenori
    SOCIAL COGNITIVE AND AFFECTIVE NEUROSCIENCE, 2014, 9 (06) : 767 - 775
  • [42] Mapping the connectivity underlying multimodal (verbal and non-verbal) semantic processing: A brain electrostimulation study
    Moritz-Gasser, Sylvie
    Herbet, Guillaume
    Duffau, Hugues
    NEUROPSYCHOLOGIA, 2013, 51 (10) : 1814 - 1822
  • [43] Incongruence between Verbal and Non-Verbal Information Enhances the Late Positive Potential
    Morioka, Shu
    Osumi, Michihiro
    Shiotani, Mayu
    Nobusako, Satoshi
    Maeoka, Hiroshi
    Okada, Yohei
    Hiyamizu, Makoto
    Matsuo, Atsushi
    PLOS ONE, 2016, 11 (10):
  • [44] Magneto- and electroencephalographic correlates of the processing of visual verbal, and non-verbal information
    Eulitz, C
    Eulitz, H
    Elbert, T
    KLINISCHE NEUROPHYSIOLOGIE, 1999, 30 (01) : 44 - 53
  • [45] Non-Verbal Learning Disability: A Neuropsychological Case Review
    Greco, S.
    Klimik, L.
    Cohen, J.
    ARCHIVES OF CLINICAL NEUROPSYCHOLOGY, 2013, 28 (06) : 558 - 558
  • [46] Unimodal and Multimodal Integrated Representation Learning via Improved Information Bottleneck for Multimodal Sentiment Analysis
    Zhang, Tonghui
    Dong, Changfei
    Su, Jinsong
    Zhang, Haiying
    Li, Yuzheng
    NATURAL LANGUAGE PROCESSING AND CHINESE COMPUTING, NLPCC 2022, PT I, 2022, 13551 : 564 - 576
  • [47] Navigating a multimodal ensemble: Learners mediating verbal and non-verbal turns in online interaction tasks
    Knight, Janine
    Dooly, Melinda
    Barbera, Elena
    RECALL, 2020, 32 (01) : 25 - 46
  • [48] VReanimate - Non-Verbal Guidance and Learning in Virtual Reality
    Blome, Tim
    Diefenbach, Alexander
    Rudolph, Stefan
    Bucher, Kristina
    von Mammen, Sebastian
    2017 9TH INTERNATIONAL CONFERENCE ON VIRTUAL WORLDS AND GAMES FOR SERIOUS APPLICATIONS (VS-GAMES), 2017, : 23 - 30
  • [49] Non-verbal voice emotion analysis system
    Mitsuyoshi, Shunji
    Ren, Fuji
    Tanaka, Yasuto
    Kuroiwa, Shingo
    INTERNATIONAL JOURNAL OF INNOVATIVE COMPUTING INFORMATION AND CONTROL, 2006, 2 (04): : 819 - 830
  • [50] Quantitative analysis of non-verbal communication for competence analysis
    Cepero, Alvaro
    Clapes, Albert
    Escalera, Sergio
    ARTIFICIAL INTELLIGENCE RESEARCH AND DEVELOPMENT: PROCEEDINGS OF THE 16TH INTERNATIONAL CONFERENCE OF THE CATALAN ASSOCIATION FOR ARTIFICIAL INTELLIGENCE, 2013, 256 : 105 - 114
12345