Reinforcement Learning for Abstractive Question Summarization with Question-aware Semantic Rewards

被引:0
|
作者
Yadav, Shweta [1 ]
Gupta, Deepak [1 ]
Ben Abacha, Asma [1 ]
Demner-Fushman, Dina [1 ]
机构
[1] US Natl Lib Med, LHNCBC, Bethesda, MD 20894 USA
基金
美国国家卫生研究院;
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The growth of online consumer health questions has led to the necessity for reliable and accurate question answering systems. A recent study showed that manual summarization of consumer health questions brings significant improvement in retrieving relevant answers. However, the automatic summarization of long questions is a challenging task due to the lack of training data and the complexity of the related subtasks, such as the question focus and type recognition. In this paper, we introduce a reinforcement learning-based framework for abstractive question summarization. We propose two novel rewards obtained from the downstream tasks of (i) question-type identification and (ii) question-focus recognition to regularize the question generation model. These rewards ensure the generation of semantically valid questions and encourage the inclusion of key medical entities/foci in the question summary. We evaluated our proposed method on two benchmark datasets and achieved higher performance over state-of-theart models. The manual evaluation of the summaries reveals that the generated questions are more diverse and have fewer factual inconsistencies than the baseline summaries. The source code is available here: https: //github.com/shwetanlp/CHQ-Summ.
引用
收藏
页码:249 / 255
页数:7
相关论文
共 50 条
  • [1] Deep Reinforcement Learning with Distributional Semantic Rewards for Abstractive Summarization
    Li, Siyao
    Lei, Deren
    Qin, Pengda
    Wang, William Yang
    [J]. 2019 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING AND THE 9TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING (EMNLP-IJCNLP 2019): PROCEEDINGS OF THE CONFERENCE, 2019, : 6038 - 6044
  • [2] Question-aware transformer models for consumer health question summarization
    Yadav, Shweta
    Gupta, Deepak
    Ben Abacha, Asma
    Demner-Fushman, Dina
    [J]. JOURNAL OF BIOMEDICAL INFORMATICS, 2022, 128
  • [3] Question-aware transformer models for consumer health question summarization
    Yadav, Shweta
    Gupta, Deepak
    Abacha, Asma Ben
    Demner-Fushman, Dina
    [J]. Journal of Biomedical Informatics, 2022, 128
  • [4] Abstractive summarization with deep reinforcement learning using semantic similarity rewards
    Fikri, Figen Beken
    Oflazer, Kemal
    Yanikoglu, Berrin
    [J]. NATURAL LANGUAGE ENGINEERING, 2024, 30 (03) : 554 - 576
  • [5] Using Question Answering Rewards to Improve Abstractive Summarization
    Gunasekara, Chulaka
    Feigenblat, Guy
    Sznajder, Benjamin
    Aharonov, Ranit
    Joshi, Sachindra
    [J]. FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, EMNLP 2021, 2021, : 518 - 526
  • [6] Question-aware dynamic scene graph of local semantic representation learning for visual question answering
    Wu, Jinmeng
    Ge, Fulin
    Hong, Hanyu
    Shi, Yu
    Hao, Yanbin
    Ma, Lei
    [J]. PATTERN RECOGNITION LETTERS, 2023, 170 : 93 - 99
  • [7] Hierarchical Question-Aware Context Learning with Augmented Data for Biomedical Question Answering
    Du, Yongping
    Guo, Wenyang
    Zhao, Yiliang
    [J]. 2019 IEEE INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOMEDICINE (BIBM), 2019, : 370 - 375
  • [8] Question-Aware Tube-Switch Network for Video Question Answering
    Yang, Tianhao
    Zha, Zheng-Jun
    Xie, Hongtao
    Wang, Meng
    Zhang, Hanwang
    [J]. PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA (MM'19), 2019, : 1184 - 1192
  • [9] Question-aware prediction with candidate answer recommendation for visual question answering
    Kim, B.
    Kim, J.
    [J]. ELECTRONICS LETTERS, 2017, 53 (18) : 1244 - 1245
  • [10] COVID-19 information retrieval with deep-learning based semantic search, question answering, and abstractive summarization
    Andre Esteva
    Anuprit Kale
    Romain Paulus
    Kazuma Hashimoto
    Wenpeng Yin
    Dragomir Radev
    Richard Socher
    [J]. npj Digital Medicine, 4