Counterfactual based reinforcement learning for graph neural networks

被引:0
|
作者
Pham, David [1 ]
Zhang, Yongfeng [1 ]
机构
[1] Rutgers State Univ, Comp Sci Dept, New Brunswick, NJ 08901 USA
关键词
Counterfactual reasoning; Graphs; Reinforcement learning;
D O I
10.1007/s10479-022-04978-9
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
There have been many models made to achieve optimal results on classification tasks. We present a novel framework that is able to augment these models to achieve even higher levels of classification accuracy. Our framework is used in addition to and flexibly on top of other models and uses a reinforcement learning approach to learn and generate new difficult training data samples in order to further refine the classification model. By making new, harder, and more meaningful data samples our framework helps the model learn meaningful relationships in the data for its classification task. This allows our framework to augment models during training rather than working on pre-trained classifiers. Through our experimentation we show that our framework improves models' classification accuracy. We also show the effectiveness of tuning our components through our ablation studies. Lastly, we discuss possible improvements to our framework and directions for future works.
引用
收藏
页数:17
相关论文
共 50 条
  • [1] Controlling Graph Dynamics with Reinforcement Learning and Graph Neural Networks
    Meirom, Eli A.
    Maron, Haggai
    Mannor, Shie
    Chechik, Gal
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 139, 2021, 139
  • [2] Reinforcement Learning Enhanced Explainer for Graph Neural Networks
    Shan, Caihua
    Shen, Yifei
    Zhang, Yao
    Li, Xiang
    Li, Dongsheng
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [3] A Deep Reinforcement Learning Heuristic for SAT based on Antagonist Graph Neural Networks
    Fournier, Thomas
    Lallouet, Arnaud
    Cropsal, Telio
    Glorian, Gael
    Papadopoulos, Alexandre
    Petitet, Antoine
    Perez, Guillaume
    Sekar, Suruthy
    Suijlen, Wijnand
    [J]. 2022 IEEE 34TH INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE, ICTAI, 2022, : 1218 - 1222
  • [4] Robust Counterfactual Explanations on Graph Neural Networks
    Bajaj, Mohit
    Chu, Lingyang
    Xue, Zi Yu
    Pei, Jian
    Wang, Lanjun
    Lam, Peter Cho-Ho
    Zhang, Yong
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [5] Towards Fair Graph Neural Networks via Graph Counterfactual
    Guo, Zhimeng
    Li, Jialiang
    Xiao, Teng
    Ma, Yao
    Wang, Suhang
    [J]. PROCEEDINGS OF THE 32ND ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2023, 2023, : 669 - 678
  • [6] Graph Partitioning and Sparse Matrix Ordering using Reinforcement Learning and Graph Neural Networks
    Gatti, Alice
    Hu, Zhixiong
    Smidt, Tess
    Ng, Esmond G.
    Ghysels, Pieter
    [J]. JOURNAL OF MACHINE LEARNING RESEARCH, 2022, 23
  • [7] Reinforcement Learning using Physics Inspired Graph Convolutional Neural Networks
    Wu, Tong
    Scaglione, Anna
    Arnold, Daniel
    [J]. 2022 58TH ANNUAL ALLERTON CONFERENCE ON COMMUNICATION, CONTROL, AND COMPUTING (ALLERTON), 2022,
  • [8] Learning and Evaluating Graph Neural Network Explanations based on Counterfactual and Factual Reasoning
    Tan, Juntao
    Geng, Shijie
    Fu, Zuohui
    Ge, Yingqiang
    Xu, Shuyuan
    Li, Yunqi
    Zhang, Yongfeng
    [J]. PROCEEDINGS OF THE ACM WEB CONFERENCE 2022 (WWW'22), 2022, : 1018 - 1027
  • [9] Graph Neural Networks and Reinforcement Learning for Behavior Generation in Semantic Environments
    Hart, Patrick
    Knoll, Alois
    [J]. 2020 IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV), 2020, : 1583 - 1588
  • [10] Flowsheet generation through hierarchical reinforcement learning and graph neural networks
    Stops, Laura
    Leenhouts, Roel
    Gao, Qinghe
    Schweidtmann, Artur M.
    [J]. AICHE JOURNAL, 2023, 69 (01)