Myanmar News Headline Generation with Sequence-to-Sequence model

被引:0
|
作者
Thu, Yamin [1 ]
Pa, Win Pa [1 ]
机构
[1] Univ Comp Studies, Nat Language Proc Lab, Yangon, Myanmar
关键词
Headline generation; Seq2Seq with one-hot encoding; ROUGE;
D O I
10.1109/o-cocosda50338.2020.9295017
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
News Headline generation is one of the most valuable research recently in NLP area. Generation of News headline means by learning to map articles to headlines using Sequence-to-Sequence model. Headline Generator that used an encoder and a decoder designed using Long Short-Term Memory (LSTM) was applied in this work. In this paper, an automatic headline generation for Myanmar News article using Seq2Seq model is implemented. There are various ways to generate a headline for news. In this paper, headline was generated using Seq2Seq with one-hot encoding and described about the comparative analysis results. While constructing the model, there are some challenges such as vocabulary counting and find out unknown terms in word embedding. In order to get more meaningful results, used the error analysis to typical neural headline generation system and evaluated based on machine generated headlines and actual headlines using ROUGE evaluation metric. The experiments have been conducted on Myanmar News dataset of 7000 pairs of news articles and their corresponding headlines. According to the evaluation, Seq2Seq with one-hot encoding outperforms than other Seq2Seq with word embedding (GloVe) and Recursive Recurrent Neural Network (Recursive RNN).
引用
收藏
页码:117 / 122
页数:6
相关论文
共 50 条
  • [1] Data generation using sequence-to-sequence
    Joshi, Akshat
    Mehta, Kinal
    Gupta, Neha
    Valloli, Varun Kannadi
    [J]. 2018 IEEE RECENT ADVANCES IN INTELLIGENT COMPUTATIONAL SYSTEMS (RAICS), 2018, : 108 - 112
  • [2] Graph augmented sequence-to-sequence model for neural question generation
    Ma, Hui
    Wang, Jian
    Lin, Hongfei
    Xu, Bo
    [J]. APPLIED INTELLIGENCE, 2023, 53 (11) : 14628 - 14644
  • [3] Graph augmented sequence-to-sequence model for neural question generation
    Hui Ma
    Jian Wang
    Hongfei Lin
    Bo Xu
    [J]. Applied Intelligence, 2023, 53 : 14628 - 14644
  • [4] Question Generation Using Sequence-to-Sequence Model with Semantic Role Labels
    Naeiji, Alireza
    An, Aijun
    Davoudi, Heidar
    Delpisheh, Marjan
    Alzghool, Muath
    [J]. 17TH CONFERENCE OF THE EUROPEAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, EACL 2023, 2023, : 2830 - 2842
  • [5] ReBoost: a retrieval-boosted sequence-to-sequence model for neural response generation
    Zhu, Yutao
    Dou, Zhicheng
    Nie, Jian-Yun
    Wen, Ji-Rong
    [J]. INFORMATION RETRIEVAL JOURNAL, 2020, 23 (01): : 27 - 48
  • [6] ReBoost: a retrieval-boosted sequence-to-sequence model for neural response generation
    Yutao Zhu
    Zhicheng Dou
    Jian-Yun Nie
    Ji-Rong Wen
    [J]. Information Retrieval Journal, 2020, 23 : 27 - 48
  • [7] Controllable Question Generation via Sequence-to-Sequence Neural Model with Auxiliary Information
    Cao, Zhen
    Tatinati, Sivanagaraja
    Khong, Andy W. H.
    [J]. 2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,
  • [8] Neural AMR: Sequence-to-Sequence Models for Parsing and Generation
    Konstas, Ioannis
    Iyer, Srinivasan
    Yatskar, Mark
    Choi, Yejin
    Zettlemoyer, Luke
    [J]. PROCEEDINGS OF THE 55TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2017), VOL 1, 2017, : 146 - 157
  • [9] Sequence-to-Sequence Models for Grapheme to Phoneme Conversion on Large Myanmar Pronunciation Dictionary
    Hlaing, Aye Mya
    Pa, Win Pa
    [J]. 2019 22ND CONFERENCE OF THE ORIENTAL COCOSDA INTERNATIONAL COMMITTEE FOR THE CO-ORDINATION AND STANDARDISATION OF SPEECH DATABASES AND ASSESSMENT TECHNIQUES (O-COCOSDA), 2019, : 149 - 153
  • [10] A Fuzzy Training Framework for Controllable Sequence-to-Sequence Generation
    Li, Jiajia
    Wang, Ping
    Li, Zuchao
    Liu, Xi
    Utiyama, Masao
    Sumita, Eiichiro
    Zhao, Hai
    Ai, Haojun
    [J]. IEEE ACCESS, 2022, 10 : 92467 - 92480