Syntax-guided controllable sentence simplification

被引:0
|
作者
Wang, Lulu [1 ,2 ]
Wumaier, Aishan [1 ,2 ]
Yibulayin, Tuergen [1 ,2 ]
Maimaiti, Maihemuti [1 ,2 ]
机构
[1] Xinjiang Univ, Sch Comp Sci & Technol, Urumqi 830046, Peoples R China
[2] Xinjiang Univ, Xinjiang Lab Multilanguage Informat Technol, Urumqi 830046, Peoples R China
关键词
Sentence simplification; Controllable; Graph attention networks; Syntactic information; Syntax-augmented decoder;
D O I
10.1016/j.neucom.2024.127675
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Sentence simplification is to rephrase a sentence into a form that is easier to read and understand while preserving its essential meaning and information. Recently, monolingual neural machine translation methods have emerged as a popular approach for this task. However, these methods often overlook the syntactic tree information of sentences, which can be crucial for effective simplification. To address this issue, we propose a syntax-guided controllable sentence simplification model that leverages graph attention networks to incorporate the syntactic information of dependency trees. Specifically, besides the sentence encoder, we propose a graph encoder that encodes dependency trees to enrich the syntactic information. Within the decoder, we introduce a syntax-augmented cross-attention that aggregates both sentence and syntax information simultaneously to the target side for simplification. We evaluate our proposed model on two benchmark datasets, showcasing that it outperforms state-of-the-art methods by a significant margin. Our proposed model underscores the significance of incorporating syntactic knowledge in sentence simplification.
引用
收藏
页数:10
相关论文
共 50 条
  • [41] Extracting relational facts based on hybrid Syntax-Guided transformer and pointer network
    Liu, Luping
    Wang, Meiling
    He, Xiaohai
    Qing, Linbo
    Zhang, Jin
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2021, 40 (06) : 12167 - 12183
  • [42] Dependency to Semantics: Structure Transformation and Syntax-Guided Attention for Neural Semantic Parsing
    Wu, Shan
    Chen, Bo
    Han, Xianpei
    Sun, Le
    KNOWLEDGE GRAPH AND SEMANTIC COMPUTING: KNOWLEDGE GRAPH EMPOWERS NEW INFRASTRUCTURE CONSTRUCTION, 2021, 1466 : 119 - 133
  • [43] Enhanced Enumeration Techniques for Syntax-Guided Synthesis of Bit-Vector Manipulations
    Ding, Yuantian
    Qiu, Xiaokang
    PROCEEDINGS OF THE ACM ON PROGRAMMING LANGUAGES-PACMPL, 2024, 8 (POPL):
  • [44] Model Checking of Verilog RTL Using IC3 with Syntax-Guided Abstraction
    Goel, Aman
    Sakallah, Karem
    NASA FORMAL METHODS (NFM 2019), 2019, 11460 : 166 - 185
  • [45] CVC4SY: Smart and Fast Term Enumeration for Syntax-Guided Synthesis
    Reynolds, Andrew
    Barbosa, Haniel
    Notzli, Andres
    Barrett, Clark
    Tinelli, Cesare
    COMPUTER AIDED VERIFICATION, CAV 2019, PT II, 2019, 11562 : 74 - 83
  • [46] A syntax-guided multi-task learning approach for Turducken-style code generation
    Guang Yang
    Yu Zhou
    Xiang Chen
    Xiangyu Zhang
    Yiran Xu
    Tingting Han
    Taolue Chen
    Empirical Software Engineering, 2023, 28
  • [47] Reaching Quality and Efficiency with a Parameter-Efficient Controllable Sentence Simplification Approach
    Menta, Antonio
    Garcia-Serrano, Ana
    COMPUTER SCIENCE AND INFORMATION SYSTEMS, 2024, 21 (03)
  • [48] NL2Viz: Natural Language to Visualization via Constrained Syntax-Guided Synthesis
    Wu, Zhengkai
    Vu Le
    Tiwari, Ashish
    Gulwani, Sumit
    Radhakrishna, Arjun
    Radicek, Ivan
    Soares, Gustavo
    Wang, Xinyu
    Li, Zhenwen
    Xie, Tao
    PROCEEDINGS OF THE 30TH ACM JOINT MEETING EUROPEAN SOFTWARE ENGINEERING CONFERENCE AND SYMPOSIUM ON THE FOUNDATIONS OF SOFTWARE ENGINEERING, ESEC/FSE 2022, 2022, : 972 - 983
  • [49] A syntax-guided multi-task learning approach for Turducken-style code generation
    Yang, Guang
    Zhou, Yu
    Chen, Xiang
    Zhang, Xiangyu
    Xu, Yiran
    Han, Tingting
    Chen, Taolue
    EMPIRICAL SOFTWARE ENGINEERING, 2023, 28 (06)
  • [50] SYNTAX AND THE SENTENCE
    HATCHER, AG
    WORD-JOURNAL OF THE INTERNATIONAL LINGUISTIC ASSOCIATION, 1956, 12 (02): : 234 - 250