Unifying Graph Retrieval and Prompt Tuning for Graph-Grounded Text Classification

被引:0
|
作者
Dai, Le [1 ]
Yin, Yu [1 ]
Chen, Enhong [1 ]
Xiong, Hui [2 ]
机构
[1] Univ Sci & Technol, Hefei, Anhui, Peoples R China
[2] Hong Kong Univ Sci & Technol Guangzhou, Guangzhou, Guangdong, Peoples R China
关键词
Graph-grounded text classification; graph retrieval; prompt tuning;
D O I
10.1145/3626772.3657934
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Text classification has long time been researched as a fundamental problem in information retrieval. Since text data are frequently connected with graph structures, it poses new possibilities for a more accurate and explainable classification. One common approach of this graph-text integration is to consider text as graph attributes and utilize GNNs to conduct a node classification task. While both text and graph data are modeled, GNNs treat text in a rather coarse-grained way, have limitations in preserving the detailed structures of a graph, and are less robust to graph sparsity. In this paper, we propose to take an alternative perspective instead, viewing graph as the context of texts, as enlightened by retrieval augmented generation. We propose a novel framework called Graph Retrieval Prompt Tuning (GRPT), consisting of a Graph Retrieval Module and a Prompt Tuning Module integrated with graph context. For graph retrieval, two retrieval strategies are designed to retrieve node context and path context, preserving both node proximity and detailed connectivity patterns. Extensive experiments on four real-world datasets show the effectiveness of our framework in both standard supervised and sparse settings.
引用
收藏
页码:2682 / 2686
页数:5
相关论文
共 50 条
  • [21] Short text classification with Soft Knowledgeable Prompt-tuning
    Zhu, Yi
    Wang, Ye
    Mu, Jianyuan
    Li, Yun
    Qiang, Jipeng
    Yuan, Yunhao
    Wu, Xindong
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2024, 246
  • [22] Graph Convolutional Networks for Fast Text Classification
    Cai, Houyv
    Lv, Shaoqing
    Lu, Guangyue
    Li, Tingting
    [J]. Proceedings - 2022 4th International Conference on Natural Language Processing, ICNLP 2022, 2022, : 420 - 425
  • [23] Recurrent Graph Neural Networks for Text Classification
    Wei, Xinde
    Huang, Hai
    Ma, Longxuan
    Yang, Ze
    Xu, Liutong
    [J]. PROCEEDINGS OF 2020 IEEE 11TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING AND SERVICE SCIENCE (ICSESS 2020), 2020, : 91 - 97
  • [24] Transformer and Graph Convolutional Network for Text Classification
    Boting Liu
    Weili Guan
    Changjin Yang
    Zhijie Fang
    Zhiheng Lu
    [J]. International Journal of Computational Intelligence Systems, 16
  • [25] Transformer and Graph Convolutional Network for Text Classification
    Liu, Boting
    Guan, Weili
    Yang, Changjin
    Fang, Zhijie
    Lu, Zhiheng
    [J]. INTERNATIONAL JOURNAL OF COMPUTATIONAL INTELLIGENCE SYSTEMS, 2023, 16 (01)
  • [26] Graph Receptive Transformer Encoder for Text Classification
    Aras, Arda Can
    Alikasifoglu, Tuna
    Koc, Aykut
    [J]. IEEE TRANSACTIONS ON SIGNAL AND INFORMATION PROCESSING OVER NETWORKS, 2024, 10 : 347 - 359
  • [27] Graph ConvolutionWord Embedding and Attention for Text Classification
    Yang, Yi
    Cui, Qihui
    Ji, Lijun
    Cheng, Zhuoran
    [J]. PROCEEDINGS OF 2022 THE 6TH INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND SOFT COMPUTING, ICMLSC 20222, 2022, : 160 - 166
  • [28] Tensor Graph Convolutional Networks for Text Classification
    Liu, Xien
    You, Xinxin
    Zhang, Xiao
    Wu, Ji
    Lv, Ping
    [J]. THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 8409 - 8416
  • [29] Exploring graph representation strategies for text classification
    Ehrenfried, Henrique Varella
    Date, Vinicius Tikara Venturi
    Todt, Eduardo
    [J]. CONNECTION SCIENCE, 2023, 35 (01)
  • [30] Review of Graph Neural Network in Text Classification
    Malekzadeh, Masoud
    Hajibabaee, Parisa
    Heidari, Maryam
    Zad, Samira
    Uzuner, Ozlem
    Jones, James H. Jr Jr
    [J]. 2021 IEEE 12TH ANNUAL UBIQUITOUS COMPUTING, ELECTRONICS & MOBILE COMMUNICATION CONFERENCE (UEMCON), 2021, : 84 - 91