Multi-hop Relational Graph Attention Network for Text-to-SQL Parsing

被引:0
|
作者
Liu, Hu [1 ]
Shi, Yuliang [1 ,2 ]
Zhang, Jianlin [1 ]
Wang, Xinjun [1 ,2 ]
Li, Hui [1 ]
Kong, Fanyu [1 ]
机构
[1] Shandong Univ, Sch Software, Jinan, Peoples R China
[2] Dareway Software Co Ltd, Jinan, Peoples R China
关键词
Natural language processing; Text-to-SQL; Semantic parsing; SQL; Graph neural network;
D O I
10.1109/IJCNN54540.2023.10191914
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Text-to-SQL aims to parse natural language problems into SQL queries, which can provide a simple interface to access large databases enabling SQL novices a quicker entry into databases. As the Text-to-SQL field is intensively studied, more and more models use GNNs to encode heterogeneous graph information in this task, and how to better obtain path information between nodes in database schema heterogeneous graphs and question-database schema heterogeneous graphs will greatly affect the effectiveness of the model parsing. Our work intends to explore the problem of solving the encoding of heterogeneous graph meta-paths in the Text-to-SQL task. Previous approaches usually use multi-layer GNNs to aggregate topological structure information between nodes. However, they ignored the structural information embedded at the edges and also failed to obtain nodes that are not directly connected but can provide contextual information through meta-paths. To solve the above problem, we propose Multi-Hop Relational Graph Attention Network based Text-to-SQL Parsing Model (MHRGATSQL) for learning topological information between nodes while obtaining semantic information embedded in the edge topology. We use multi-hop attention to modify the relational graph attention network to diffuse the attention scores throughout the network, thus increasing the "receptive field" of each layer of RGAT. Experimental results on the large-scale cross-domain Text-to-SQL dataset Spider show that our model obtains an absolute improvement of 1.7% compared to the baseline and alleviates the over-smoothing problem in the deep network model.
引用
收藏
页数:8
相关论文
共 50 条
  • [31] SADGA: Structure-Aware Dual Graph Aggregation Network for Text-to-SQL
    Cai, Ruichu
    Yuan, Jinjie
    Xu, Boyan
    Hao, Zhifeng
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [32] Graph Reasoning Enhanced Language Models for Text-to-SQL
    Gong, Zheng
    Sun, Ying
    PROCEEDINGS OF THE 47TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, SIGIR 2024, 2024, : 2447 - 2451
  • [33] Cnn-assisted multi-hop graph attention network for hyperspectral image classification
    Wang, Hongxi
    Guo, Wenhui
    Wang, Xueqin
    Wang, Yanjiang
    INTERNATIONAL JOURNAL OF REMOTE SENSING, 2024, 45 (22) : 8258 - 8289
  • [34] Leveraging Explicit Lexico-logical Alignments in Text-to-SQL Parsing
    Sun, Runxin
    He, Shizhu
    Zhu, Chong
    He, Yaohan
    Li, Jinlong
    Zhao, Jun
    Liu, Kang
    PROCEEDINGS OF THE 60TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2022): (SHORT PAPERS), VOL 2, 2022, : 283 - 289
  • [35] Importance of Synthesizing High-quality Data for Text-to-SQL Parsing
    Hu, Yiqun
    Zhao, Yiyun
    Jiang, Jiarong
    Lan, Wuwei
    Zhu, Henry
    Chauhan, Anuj
    Li, Alexander
    Pan, Lin
    Wang, Jun
    Hang, Chung-Wei
    Zhang, Sheng
    Guo, Jiang
    Dong, Marvin
    Lilien, Joe
    Ng, Patrick
    Wang, Zhiguo
    Castelli, Vittorio
    Xiang, Bing
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, ACL 2023, 2023, : 1327 - 1343
  • [36] Attention-based Multi-hop Reasoning for Knowledge Graph
    Wang, Zikang
    Li, Linjing
    Zeng, Daniel Dajun
    Chen, Yue
    2018 IEEE INTERNATIONAL CONFERENCE ON INTELLIGENCE AND SECURITY INFORMATICS (ISI), 2018, : 211 - 213
  • [37] Conversational recommender based on graph sparsification and multi-hop attention
    Zhang, Yihao
    Wang, Yuhao
    Zhou, Wei
    Lan, Pengxiang
    Xiang, Haoran
    Zhu, Junlin
    Yuan, Meng
    INTELLIGENT DATA ANALYSIS, 2024, 28 (01) : 99 - 119
  • [38] Hierarchical Graph Network for Multi-hop Question Answering
    Fang, Yuwei
    Sun, Siqi
    Gan, Zhe
    Pillai, Rohit
    Wang, Shuohang
    Liu, Jingjing
    PROCEEDINGS OF THE 2020 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP), 2020, : 8823 - 8838
  • [39] Dynamically Fused Graph Network for Multi-hop Reasoning
    Qiu, Lin
    Xiao, Yunxuan
    Qu, Yanru
    Zhou, Hao
    Li, Lei
    Zhang, Weinan
    Yu, Yong
    57TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2019), 2019, : 6140 - 6150
  • [40] Node Classification with Multi-hop Graph Convolutional Network
    Jui, Tonni Das
    Benton, Mary Lauren
    Baker, Erich
    RECENT ADVANCES IN NEXT-GENERATION DATA SCIENCE, SDSC 2024, 2024, 2158 : 199 - 213