Heuristic personality recognition based on fusing multiple conversations and utterance-level affection

被引:0
|
作者
He, Haijun [1 ]
Li, Bobo [1 ]
Xiong, Yiyun [1 ]
Zheng, Li [1 ]
He, Kang [1 ]
Li, Fei [1 ]
Ji, Donghong [1 ]
机构
[1] Wuhan Univ, Sch Cyber Sci & Engn, Key Lab Aerosp Informat Secur & Trusted Comp, Minist Educ, Wuhan, Peoples R China
基金
中国国家自然科学基金;
关键词
Personality recognition; Conversation analysis; Natural language processing;
D O I
10.1016/j.ipm.2024.103931
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Personality Recognition in Conversations (PRC) is a task of significant interest and practical value. Existing studies on the PRC task utilize conversation inadequately and neglect affective information. Considering the way of information processing of these studies is not yet close enough to the concept of personality, we propose the SAH-GCN model for the PRC task in this study. This model initially processes the original conversation input to extract the central speaker feature. Leveraging Contrastive Learning, it continuously adjusts the embedding of each utterance by incorporating affective information to cope with the semantic similarity. Subsequently, the model employs Graph Convolutional Networks to simulate the conversation dynamics, ensuring comprehensive interaction between the central speaker feature and other relevant features. Lastly, it heuristically fuses central speaker features from multiple conversations involving the same speaker into one comprehensive feature, facilitating personality recognition. We conduct experiments using the recently released CPED dataset, which is the personality dataset encompassing affection labels and conversation details. Our results demonstrate that SAH-GCN achieves superior accuracy (+1.88%) compared to prior works on the PRC task. Further analysis verifies the efficacy of our scheme that fuses multiple conversations and incorporates affective information for personality recognition.
引用
收藏
页数:13
相关论文
共 36 条
  • [31] Matched Filter Based Spectrum Sensing and Power Level Recognition with Multiple Antennas
    Lv, Qing
    Gao, Feifei
    2015 IEEE CHINA SUMMIT & INTERNATIONAL CONFERENCE ON SIGNAL AND INFORMATION PROCESSING, 2015, : 305 - 309
  • [32] Score level fusion method based on multiple oblique gradient operators for face recognition
    Zhaokui Li
    Lixin Ding
    Yan Wang
    Multimedia Tools and Applications, 2016, 75 : 819 - 837
  • [33] Score level fusion method based on multiple oblique gradient operators for face recognition
    Li, Zhaokui
    Ding, Lixin
    Wang, Yan
    MULTIMEDIA TOOLS AND APPLICATIONS, 2016, 75 (02) : 819 - 837
  • [34] Automatic Speech Recognition Based on Multiple Level Units in Spoken Dialogue System for In-Vehicle Appliances
    Nishida, Masafumi
    Horiuchi, Yasuo
    Kuroiwa, Shingo
    Ichikawa, Akira
    TEXT, SPEECH AND DIALOGUE, 2010, 6231 : 539 - +
  • [35] Lipreading Architecture Based on Multiple Convolutional Neural Networks for Sentence-Level Visual Speech Recognition
    Jeon, Sanghun
    Elsharkawy, Ahmed
    Kim, Mun Sang
    SENSORS, 2022, 22 (01)
  • [36] Speech recognition using non-linear trajectories in a formant-based articulatory layer of a multiple-level segmental HMM
    Hu, Hongwei
    Russell, Martin J.
    INTERSPEECH 2008: 9TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION 2008, VOLS 1-5, 2008, : 2422 - 2425