Neural abstractive summarization fusing by global generative topics

被引:0
|
作者
Yang Gao
Yang Wang
Luyang Liu
Yidi Guo
Heyan Huang
机构
[1] School of Computer Science and Technology,
[2] Beijing Institute of Technology,undefined
来源
关键词
Neural network; Variational auto-encoding; Abstractive summarization; Deep learning;
D O I
暂无
中图分类号
学科分类号
摘要
Various efforts have been dedicated to automatically generate coherent, condensed and informative summaries. Most concentrate on improving the capability of generating neural language models locally, but do not consider global information. In real cases, a summary is comprehensively influenced by the full content of the source text and is especially guided by its core sense. To seamlessly integrate global semantic representation into a summarization generation system, we propose to incorporate a neural generative topic matrix as an abstractive level of topic information. By mapping global semantics into a local generative language model, the abstractive summarization is capable of generating succinct and recapitulative words or phrases. Extensive experiments on DUC-2004 and Gigaword datasets convincingly validate the proposed model.
引用
收藏
页码:5049 / 5058
页数:9
相关论文
共 50 条
  • [1] Neural abstractive summarization fusing by global generative topics
    Gao, Yang
    Wang, Yang
    Liu, Luyang
    Guo, Yidi
    Huang, Heyan
    [J]. NEURAL COMPUTING & APPLICATIONS, 2020, 32 (09): : 5049 - 5058
  • [2] Global Encoding for Abstractive Summarization
    Lin, Junyang
    Sun, Xu
    Ma, Shuming
    Su, Qi
    [J]. PROCEEDINGS OF THE 56TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, VOL 2, 2018, : 163 - 169
  • [3] Global-aware Beam Search for Neural Abstractive Summarization
    Ma, Ye
    Lan, Zixun
    Zong, Lu
    Huang, Kaizhu
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [4] Generative Adversarial Network for Abstractive Text Summarization
    Liu, Linqing
    Lu, Yao
    Yang, Min
    Qu, Qiang
    Zhu, Jia
    Li, Hongyan
    [J]. THIRTY-SECOND AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTIETH INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / EIGHTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2018, : 8109 - 8110
  • [5] Neural Abstractive Summarization with Structural Attention
    Chowdhury, Tanya
    Kumar, Sachin
    Chakraborty, Tanmoy
    [J]. PROCEEDINGS OF THE TWENTY-NINTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2020, : 3716 - 3722
  • [6] Variational Neural Decoder for Abstractive Text Summarization
    Zhao, Huan
    Cao, Jie
    Xu, Mingquan
    Lu, Jian
    [J]. COMPUTER SCIENCE AND INFORMATION SYSTEMS, 2020, 17 (02) : 537 - 552
  • [7] Recurrent neural network for abstractive summarization of documents
    Bansal, Neha
    Sharma, Arun
    Singh, R. K.
    [J]. JOURNAL OF DISCRETE MATHEMATICAL SCIENCES & CRYPTOGRAPHY, 2020, 23 (01): : 65 - 72
  • [8] Understanding Neural Abstractive Summarization Models via Uncertainty
    Xu, Jiacheng
    Desai, Shrey
    Durrett, Greg
    [J]. PROCEEDINGS OF THE 2020 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP), 2020, : 6275 - 6281
  • [9] Improving named entity correctness of abstractive summarization by generative negative sampling
    Chen, Zheng
    Lin, Hongyu
    [J]. COMPUTER SPEECH AND LANGUAGE, 2023, 81
  • [10] Topic Attentional Neural Network for Abstractive Document Summarization
    Liu, Hao
    Zheng, Hai-Tao
    Wang, Wei
    [J]. ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PAKDD 2019, PT II, 2019, 11440 : 70 - 81