Syntax-guided controllable sentence simplification

被引:0
|
作者
Wang, Lulu [1 ,2 ]
Wumaier, Aishan [1 ,2 ]
Yibulayin, Tuergen [1 ,2 ]
Maimaiti, Maihemuti [1 ,2 ]
机构
[1] Xinjiang Univ, Sch Comp Sci & Technol, Urumqi 830046, Peoples R China
[2] Xinjiang Univ, Xinjiang Lab Multilanguage Informat Technol, Urumqi 830046, Peoples R China
关键词
Sentence simplification; Controllable; Graph attention networks; Syntactic information; Syntax-augmented decoder;
D O I
10.1016/j.neucom.2024.127675
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Sentence simplification is to rephrase a sentence into a form that is easier to read and understand while preserving its essential meaning and information. Recently, monolingual neural machine translation methods have emerged as a popular approach for this task. However, these methods often overlook the syntactic tree information of sentences, which can be crucial for effective simplification. To address this issue, we propose a syntax-guided controllable sentence simplification model that leverages graph attention networks to incorporate the syntactic information of dependency trees. Specifically, besides the sentence encoder, we propose a graph encoder that encodes dependency trees to enrich the syntactic information. Within the decoder, we introduce a syntax-augmented cross-attention that aggregates both sentence and syntax information simultaneously to the target side for simplification. We evaluate our proposed model on two benchmark datasets, showcasing that it outperforms state-of-the-art methods by a significant margin. Our proposed model underscores the significance of incorporating syntactic knowledge in sentence simplification.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] Syntax-guided Neural Module Distillation to Probe Compositionality in Sentence Embeddings
    Pandey, Rohan
    17TH CONFERENCE OF THE EUROPEAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, EACL 2023, 2023, : 3143 - 3149
  • [2] Syntax-Guided Synthesis
    Alur, Rajeev
    Bodik, Rastislav
    Dallal, Eric
    Fisman, Dana
    Garg, Pranav
    Juniwal, Garvit
    Kress-Gazit, Hadas
    Madhusudan, P.
    Martin, Milo M. K.
    Raghothaman, Mukund
    Saha, Shamwaditya
    Seshia, Sanjit A.
    Singh, Rishabh
    Solar-Lezama, Armando
    Torlak, Emina
    Udupa, Abhishek
    DEPENDABLE SOFTWARE SYSTEMS ENGINEERING, 2015, 40 : 1 - 25
  • [3] Syntax-Guided Synthesis
    Alur, Rajeev
    Bodik, Rastislav
    Juniwal, Garvit
    Martin, Milo M. K.
    Raghothaman, Mukund
    Seshia, Sanjit A.
    Singh, Rishabh
    Solar-Lezama, Armando
    Torlak, Emina
    Udupa, Abhishek
    2013 FORMAL METHODS IN COMPUTER-AIDED DESIGN (FMCAD), 2013, : 1 - 8
  • [4] Syntax-Guided Termination Analysis
    Fedyukovich, Grigory
    Zhang, Yueling
    Gupta, Aarti
    COMPUTER AIDED VERIFICATION (CAV 2018), PT I, 2018, 10981 : 124 - 143
  • [5] Controllable Sentence Simplification
    Martin, Louis
    de la Clergerie, Eric Villemonte
    Sagot, Benoit
    Bordes, Antoine
    PROCEEDINGS OF THE 12TH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION (LREC 2020), 2020, : 4689 - 4698
  • [6] Accelerating Syntax-Guided Invariant Synthesis
    Fedyukovich, Grigory
    Bodik, Rastislav
    TOOLS AND ALGORITHMS FOR THE CONSTRUCTION AND ANALYSIS OF SYSTEMS, TACAS 2018, PT I, 2018, 10805 : 251 - 269
  • [7] Syntax-Guided Enumeration of Temporal Properties
    Martino, Gianluca
    Fey, Goerschwin
    PROCEEDINGS OF THE 2019 FORUM ON SPECIFICATION AND DESIGN LANGUAGES (FDL), 2019,
  • [8] Grammar Filtering for Syntax-Guided Synthesis
    Morton, Kairo
    Hallahan, William
    Shum, Elven
    Piskac, Ruzica
    Santolucito, Mark
    THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 1611 - 1618
  • [9] Perses: Syntax-Guided Program Reduction
    Sun, Chengnian
    Li, Yuanbo
    Zhang, Qirun
    Gu, Tianxiao
    Su, Zhendong
    PROCEEDINGS 2018 IEEE/ACM 40TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING (ICSE), 2018, : 361 - 371
  • [10] Syntax-Guided Controlled Generation of Paraphrases
    Kumar, Ashutosh
    Ahuja, Kabir
    Vadapalli, Raghuram
    Talukdar, Partha
    TRANSACTIONS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, 2020, 8 (08) : 330 - 345