Unifying Graph Retrieval and Prompt Tuning for Graph-Grounded Text Classification

被引:0
|
作者
Dai, Le [1 ]
Yin, Yu [1 ]
Chen, Enhong [1 ]
Xiong, Hui [2 ]
机构
[1] Univ Sci & Technol, Hefei, Anhui, Peoples R China
[2] Hong Kong Univ Sci & Technol Guangzhou, Guangzhou, Guangdong, Peoples R China
关键词
Graph-grounded text classification; graph retrieval; prompt tuning;
D O I
10.1145/3626772.3657934
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Text classification has long time been researched as a fundamental problem in information retrieval. Since text data are frequently connected with graph structures, it poses new possibilities for a more accurate and explainable classification. One common approach of this graph-text integration is to consider text as graph attributes and utilize GNNs to conduct a node classification task. While both text and graph data are modeled, GNNs treat text in a rather coarse-grained way, have limitations in preserving the detailed structures of a graph, and are less robust to graph sparsity. In this paper, we propose to take an alternative perspective instead, viewing graph as the context of texts, as enlightened by retrieval augmented generation. We propose a novel framework called Graph Retrieval Prompt Tuning (GRPT), consisting of a Graph Retrieval Module and a Prompt Tuning Module integrated with graph context. For graph retrieval, two retrieval strategies are designed to retrieve node context and path context, preserving both node proximity and detailed connectivity patterns. Extensive experiments on four real-world datasets show the effectiveness of our framework in both standard supervised and sparse settings.
引用
收藏
页码:2682 / 2686
页数:5
相关论文
共 50 条
  • [1] Augmenting Low-Resource Text Classification with Graph-Grounded Pre-training and Prompting
    Wen, Zhihao
    Fang, Yuan
    [J]. PROCEEDINGS OF THE 46TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, SIGIR 2023, 2023, : 506 - 516
  • [2] Prompt Tuning on Graph-Augmented Low-Resource Text Classification
    Wen, Zhihao
    Fang, Yuan
    [J]. IEEE Transactions on Knowledge and Data Engineering, 2024, 36 (12) : 9080 - 9095
  • [3] Graph-Grounded Goal Planning for Conversational Recommendation
    Liu, Zeming
    Zhou, Ding
    Liu, Hao
    Wang, Haifeng
    Niu, Zheng-Yu
    Wu, Hua
    Che, Wanxiang
    Liu, Ting
    Xiong, Hui
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (05) : 4923 - 4939
  • [4] G-Prompt: Graphon-based Prompt Tuning for graph classification
    Duan, Yutai
    Liu, Jie
    Chen, Shaowei
    Chen, Liyi
    Wu, Jianhua
    [J]. INFORMATION PROCESSING & MANAGEMENT, 2024, 61 (03)
  • [5] Universal Prompt Tuning for Graph Neural Networks
    Fang, Taoran
    Zhang, Yunchao
    Yang, Yang
    Wang, Chunping
    Chen, Lei
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [6] PTR: Prompt Tuning with Rules for Text Classification
    Han, Xu
    Zhao, Weilin
    Ding, Ning
    Liu, Zhiyuan
    Sun, Maosong
    [J]. AI OPEN, 2022, 3 : 182 - 192
  • [7] GPPT: Graph Pre-training and Prompt Tuning to Generalize Graph Neural Networks
    Sun, Mingchen
    Zhou, Kaixiong
    He, Xin
    Wang, Ying
    Wang, Xin
    [J]. PROCEEDINGS OF THE 28TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2022, 2022, : 1717 - 1727
  • [8] Conceptual Graph Based Text Classification
    Wan, Yi
    He, Tingting
    Tu, Xinhui
    [J]. PROCEEDINGS OF 2014 IEEE INTERNATIONAL CONFERENCE ON PROGRESS IN INFORMATICS AND COMPUTING (PIC), 2014, : 104 - 113
  • [9] Graph Convolutional Networks for Text Classification
    Yao, Liang
    Mao, Chengsheng
    Luo, Yuan
    [J]. THIRTY-THIRD AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FIRST INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / NINTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, : 7370 - 7377
  • [10] Graph topology enhancement for text classification
    Rui Song
    Fausto Giunchiglia
    Ke Zhao
    Mingjie Tian
    Hao Xu
    [J]. Applied Intelligence, 2022, 52 : 15091 - 15104