Improving AMR parsing by exploiting the dependency parsing as an auxiliary task

被引:2
|
作者
Wu, Taizhong [1 ]
Zhou, Junsheng [1 ]
Qu, Weiguang [1 ]
Gu, Yanhui [1 ]
Li, Bin [1 ]
Zhong, Huilin [1 ]
Long, Yunfei [2 ]
机构
[1] Nanjing Normal Univ, Sch Comp Sci & Technol, Nanjing, Peoples R China
[2] Univ Essex, Sch Comp Sci & Elect Engn, Colchester, Essex, England
关键词
Abstract meaning representations; Multi-task learning; Dependency-auxiliary AMR parser; Neural network;
D O I
10.1007/s11042-020-09967-3
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
meaning representations (AMRs) represent sentence semantics as rooted labeled directed acyclic graphs. Though there is a strong correlation between the AMR graph of a sentence and its corresponding dependency tree, the recent neural network AMR parsers do neglect the exploitation of dependency structure information. In this paper, we explore a novel approach to exploiting dependency structures for AMR parsing. Unlike traditional pipeline models, we treat dependency parsing as an auxiliary task for AMR parsing under the multi-task learning framework by sharing neural network parameters and selectively extracting syntactic representation by the attention mechanism. Particularly, to balance the gradients and focus on the AMR parsing task, we present a new dynamical weighting scheme in the loss function. The experimental results on the LDC2015E86 and LDC2017T10 dataset show that our dependency-auxiliary AMR parser significantly outperforms the baseline and its pipeline counterpart, and demonstrate that the neural AMR parsers can be greatly boosted with the help of effective methods of integrating syntax.
引用
收藏
页码:30827 / 30838
页数:12
相关论文
共 50 条
  • [31] Improving Graph-Based Dependency Parsing Models With Dependency Language Models
    Zhang, Min
    Chen, Wenliang
    Duan, Xiangyu
    Zhang, Rong
    IEEE TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2013, 21 (11): : 2313 - 2323
  • [32] Improving Unsupervised Dependency Parsing with Knowledge from Query Logs
    Qiao, Xiuming
    Cao, Hailong
    Zhao, Tiejun
    ACM TRANSACTIONS ON ASIAN AND LOW-RESOURCE LANGUAGE INFORMATION PROCESSING, 2016, 16 (01)
  • [33] Dependency Parsing as Head Selection
    Zhang, Xingxing
    Cheng, Jianpeng
    Lapata, Mirella
    15TH CONFERENCE OF THE EUROPEAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (EACL 2017), VOL 1: LONG PAPERS, 2017, : 665 - 676
  • [34] Partial Dependency Parsing for Irish
    Dhonnchadha, Elaine Ui
    Van Genabith, Josef
    LREC 2010 - SEVENTH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION, 2010,
  • [35] Exploiting Limited Data for Parsing
    Li, Dongchen
    Zhang, Xiantao
    Wu, Xihong
    2014 IEEE/ACIS 13TH INTERNATIONAL CONFERENCE ON COMPUTER AND INFORMATION SCIENCE (ICIS), 2014, : 171 - 175
  • [36] Going to the Roots of Dependency Parsing
    Ballesteros, Miguel
    Nivre, Joakim
    COMPUTATIONAL LINGUISTICS, 2013, 39 (01) : 5 - 13
  • [37] Dependency parsing for Vietnamese Language
    Manh-Ke Tran
    Nguyen, Le-Minh
    Hoang, Diep
    RECENT ADVANCES OF ASIAN LANGUAGE PROCESSING TECHNOLOGIES, 2008, : 34 - +
  • [38] Global Greedy Dependency Parsing
    Li, Zuchao
    Zhao, Hai
    Parnow, Kevin
    THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 8319 - 8326
  • [39] Compositional Generalization in Dependency Parsing
    Goodwin, Emily
    Reddy, Siva
    O'Donnell, Timothy J.
    Bandanae, Dzmitry
    PROCEEDINGS OF THE 60TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2022), VOL 1: (LONG PAPERS), 2022, : 6482 - 6493
  • [40] Dependency parsing with structure knowledge
    Fan, Shixi
    Hou, Yongshuai
    Chen, Lidan
    2014 TENTH INTERNATIONAL CONFERENCE ON INTELLIGENT INFORMATION HIDING AND MULTIMEDIA SIGNAL PROCESSING (IIH-MSP 2014), 2014, : 337 - 340