Interpreting open-domain dialogue generation by disentangling latent feature representations

被引:0
|
作者
Wang, Ye [1 ]
Liao, Jingbo [1 ]
Yu, Hong [1 ]
Wang, Guoyin [1 ]
Zhang, Xiaoxia [1 ]
Liu, Li [1 ]
机构
[1] Chongqing Univ Posts & Telecommun, Chongqing Key Lab Computat Intelligence, Chongqing 400065, Peoples R China
来源
NEURAL COMPUTING & APPLICATIONS | 2023年 / 35卷 / 28期
基金
中国国家自然科学基金;
关键词
Deep learning interpretability; Open-domain dialogue; Feature disentanglement;
D O I
10.1007/s00521-023-08815-3
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Currently end-to-end deep learning based open-domain dialogue systems remain black box models, making it easy to generate irrelevant contents with data-driven models. Specifically, latent variables are highly entangled with different semantics in the latent space due to the lack of priori knowledge to guide the training. To address this problem, this paper proposes to harness the generative model with a priori knowledge through a cognitive approach involving feature disentanglement. Particularly, the model integrates the guided-category knowledge and open-domain dialogue data for the training, leveraging the priori knowledge into the latent space, which enables the model to disentangle the latent variables. Besides, this paper proposes a new metric for open-domain dialogues, which can objectively evaluate the interpretability of the latent space distribution. Finally, this paper validates our model on different datasets and experimentally demonstrate that our model is able to generate higher quality and more interpretable dialogues than other models.
引用
下载
收藏
页码:20855 / 20867
页数:13
相关论文
共 50 条
  • [41] The Dialogue Dodecathlon: Open-Domain Knowledge and Image Grounded Conversational Agents
    Shuster, Kurt
    Ju, Da
    Roller, Stephen
    Dinan, Emily
    Boureau, Y-Lan
    Weston, Jason
    58TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2020), 2020, : 2453 - 2470
  • [42] Towards Building an Open-Domain Dialogue System Incorporated With Internet Memes
    Lu, Hua
    Guo, Zhen
    Li, Chanjuan
    Yang, Yunyi
    He, Huang
    Bao, Siqi
    IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2024, 32 : 721 - 726
  • [43] Towards Building an Open-Domain Dialogue System Incorporated With Internet Memes
    Lu, Hua
    Guo, Zhen
    Li, Chanjuan
    Yang, Yunyi
    He, Huang
    Bao, Siqi
    IEEE/ACM Transactions on Audio Speech and Language Processing, 2024, 32 : 721 - 726
  • [44] Unstructured Text Enhanced Open-Domain Dialogue System: A Systematic Survey
    Ma, Longxuan
    Li, Mingda
    Zhang, Wei-Nan
    Li, Jiapeng
    Liu, Ting
    ACM TRANSACTIONS ON INFORMATION SYSTEMS, 2022, 40 (01)
  • [45] DART: Open-Domain Structured Data Record to Text Generation
    Nan, Linyong
    Radev, Dragomir
    Zhang, Rui
    Rau, Amrit
    Sivaprasad, Abhinand
    Hsieh, Chiachun
    Tang, Xiangru
    Vyas, Aadit
    Verma, Neha
    Krishna, Pranav
    Liu, Yangxiaokang
    Irwanto, Nadia
    Pan, Jessica
    Rahman, Faiaz
    Zaidi, Ahmad
    Mutuma, Mutethia
    Tarabar, Yasin
    Gupta, Ankit
    Yu, Tao
    Tan, Yi Chern
    Lin, Xi Victoria
    Xiong, Caiming
    Socher, Richard
    Rajani, Nazneen Fatema
    2021 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES (NAACL-HLT 2021), 2021, : 432 - 447
  • [46] Investigating Evaluation of Open-Domain Dialogue Systems With Human Generated Multiple References
    Gupta, Prakhar
    Mehri, Shikib
    Zhao, Tiancheng
    Pavel, Amy
    Eskenazi, Maxine
    Bigham, Jeffrey P.
    20TH ANNUAL MEETING OF THE SPECIAL INTEREST GROUP ON DISCOURSE AND DIALOGUE (SIGDIAL 2019), 2019, : 379 - 391
  • [47] Open-domain Multi-turn Dialogue Model Based on Knowledge Enhancement
    Xu F.
    Xu J.-M.
    Ma Y.
    Wang M.-W.
    Zhou G.-D.
    Ruan Jian Xue Bao/Journal of Software, 2024, 35 (02): : 758 - 772
  • [48] Predictive Engagement: An Efficient Metric for Automatic Evaluation of Open-Domain Dialogue Systems
    Ghazarian, Sarik
    Weischedel, Ralph
    Galstyan, Aram
    Peng, Nanyun
    THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 7789 - 7796
  • [49] ACCENT: An Automatic Event Commonsense Evaluation Metric for Open-Domain Dialogue Systems
    Ghazarian, Sarik
    Shao, Yijia
    Han, Rujun
    Galstyan, Aram
    Peng, Nanyun
    PROCEEDINGS OF THE 61ST ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, ACL 2023, VOL 1, 2023, : 4398 - 4419
  • [50] I already said that! Degenerating redundant questions in open-domain dialogue systems
    Mai, Long
    Carson-Berndsen, Julie
    PROCEEDINGS OF THE 61ST ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, ACL-SRW 2023, VOL 4, 2023, : 226 - 236