Heuristic personality recognition based on fusing multiple conversations and utterance-level affection

被引:0
|
作者
He, Haijun [1 ]
Li, Bobo [1 ]
Xiong, Yiyun [1 ]
Zheng, Li [1 ]
He, Kang [1 ]
Li, Fei [1 ]
Ji, Donghong [1 ]
机构
[1] Wuhan Univ, Sch Cyber Sci & Engn, Key Lab Aerosp Informat Secur & Trusted Comp, Minist Educ, Wuhan, Peoples R China
基金
中国国家自然科学基金;
关键词
Personality recognition; Conversation analysis; Natural language processing;
D O I
10.1016/j.ipm.2024.103931
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Personality Recognition in Conversations (PRC) is a task of significant interest and practical value. Existing studies on the PRC task utilize conversation inadequately and neglect affective information. Considering the way of information processing of these studies is not yet close enough to the concept of personality, we propose the SAH-GCN model for the PRC task in this study. This model initially processes the original conversation input to extract the central speaker feature. Leveraging Contrastive Learning, it continuously adjusts the embedding of each utterance by incorporating affective information to cope with the semantic similarity. Subsequently, the model employs Graph Convolutional Networks to simulate the conversation dynamics, ensuring comprehensive interaction between the central speaker feature and other relevant features. Lastly, it heuristically fuses central speaker features from multiple conversations involving the same speaker into one comprehensive feature, facilitating personality recognition. We conduct experiments using the recently released CPED dataset, which is the personality dataset encompassing affection labels and conversation details. Our results demonstrate that SAH-GCN achieves superior accuracy (+1.88%) compared to prior works on the PRC task. Further analysis verifies the efficacy of our scheme that fuses multiple conversations and incorporates affective information for personality recognition.
引用
收藏
页数:13
相关论文
共 36 条
  • [1] CausalDialogue: Modeling Utterance-level Causality in Conversations
    Tuan, Yi-Lin
    Albalak, Alon
    Xu, Wenda
    Saxon, Michael
    Pryor, Connor
    Getoor, Lise
    Wang, William Yang
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2023), 2023, : 12506 - 12522
  • [2] UTTERANCE-LEVEL AGGREGATION FOR SPEAKER RECOGNITION IN THE WILD
    Xie, Weidi
    Nagrani, Arsha
    Chung, Joon Son
    Zisserman, Andrew
    2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2019, : 5791 - 5795
  • [3] Hierarchical Transformer Network for Utterance-Level Emotion Recognition
    Li, Qingbiao
    Wu, Chunhua
    Wang, Zhe
    Zheng, Kangfeng
    APPLIED SCIENCES-BASEL, 2020, 10 (13):
  • [4] Improved Emotion Recognition with Novel Global Utterance-level Features
    Huang, Yongming
    Zhang, Guobao
    Li, Xiong
    Da, Feipeng
    APPLIED MATHEMATICS & INFORMATION SCIENCES, 2011, 5 (02): : 147 - 153
  • [5] Fusion Techniques for Utterance-Level Emotion Recognition Combining Speech and Transcripts
    Sebastian, Jilt
    Pierucci, Piero
    INTERSPEECH 2019, 2019, : 51 - 55
  • [6] Utterance-level extractive summarization of open-domain spontaneous conversations with rich features
    Zhu, Xiaodan
    Penn, Gerald
    2006 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO - ICME 2006, VOLS 1-5, PROCEEDINGS, 2006, : 793 - +
  • [7] Learning Utterance-level Representations with Label Smoothing for Speech Emotion Recognition
    Huang, Jian
    Tao, Jianhua
    Liu, Bin
    Lian, Zheng
    INTERSPEECH 2020, 2020, : 4079 - 4083
  • [8] HiGRU: Hierarchical Gated Recurrent Units for Utterance-level Emotion Recognition
    Jiao, Wenxiang
    Yang, Haiqin
    King, Irwin
    Lyu, Michael R.
    2019 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES (NAACL HLT 2019), VOL. 1, 2019, : 397 - 406
  • [9] Deep Learning of Segment-Level Feature Representation with Multiple Instance Learning for Utterance-Level Speech Emotion Recognition
    Mao, Shuiyang
    Ching, P. C.
    Lee, Tan
    INTERSPEECH 2019, 2019, : 1686 - 1690
  • [10] Exploring the Role of Context in Utterance-level Emotion, Act and Intent Classification in Conversations: An Empirical Study
    Ghosal, Deepanway
    Majumder, Navonil
    Mihalcea, Rada
    Poria, Soujanya
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, ACL-IJCNLP 2021, 2021, : 1435 - 1449