Challenges and Opportunities in Deep Reinforcement Learning With Graph Neural Networks: A Comprehensive Review of Algorithms and Applications

被引:14
|
作者
Munikoti, Sai [1 ]
Agarwal, Deepesh [2 ]
Das, Laya [3 ]
Halappanavar, Mahantesh [1 ]
Natarajan, Balasubramaniam [2 ]
机构
[1] Pacific Northwest Natl Lab, Data Sci & Machine Intelligence Grp, Richland, WA 99354 USA
[2] Kansas State Univ, Dept Elect & Comp Engn, Manhattan, KS 66506 USA
[3] Swiss Fed Inst Technol, Reliabil & Risk Engn Lab, CH-8092 Zurich, Switzerland
基金
美国国家科学基金会;
关键词
Deep learning; deep reinforcement learning (DRL); graph neural network (GNN); hybrid DRL-GNN; survey;
D O I
10.1109/TNNLS.2023.3283523
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Deep reinforcement learning (DRL) has empowered a variety of artificial intelligence fields, including pattern recognition, robotics, recommendation systems, and gaming. Similarly, graph neural networks (GNNs) have also demonstrated their superior performance in supervised learning for graphstructured data. In recent times, the fusion of GNN with DRL for graph-structured environments has attracted a lot of attention. This article provides a comprehensive review of these hybrid works. These works can be classified into two categories: 1) algorithmic contributions, where DRL and GNN complement each other with an objective of addressing each other's shortcomings and 2) application-specific contributions that leverage a combined GNN-DRL formulation to address problems specific to different applications. This fusion effectively addresses various complex problems in engineering and life sciences. Based on the review, we further analyze the applicability and benefits of fusing these two domains, especially in terms of increasing generalizability and reducing computational complexity. Finally, the key challenges in integrating DRL and GNN, and potential future research directions are highlighted, which will be of interest to the broader machine learning community.
引用
收藏
页码:1 / 21
页数:21
相关论文
共 50 条
  • [1] A comprehensive review on ensemble deep learning: Opportunities and challenges
    Mohammed, Ammar
    Kora, Rania
    [J]. JOURNAL OF KING SAUD UNIVERSITY-COMPUTER AND INFORMATION SCIENCES, 2023, 35 (02) : 757 - 774
  • [2] A Transfer Approach Using Graph Neural Networks in Deep Reinforcement Learning
    Yang, Tianpei
    You, Heng
    Hao, Jianye
    Zheng, Yan
    Taylor, Matthew E.
    [J]. THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 15, 2024, : 16352 - 16360
  • [3] Cooperating Graph Neural Networks With Deep Reinforcement Learning for Vaccine Prioritization
    Ling, Lu
    Mondal, Washim Uddin
    Ukkusuri, Satish, V
    [J]. IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2024, 28 (08) : 4891 - 4902
  • [4] Comprehensive Review of Deep Reinforcement Learning Methods and Applications in Economics
    Mosavi, Amirhosein
    Faghan, Yaser
    Ghamisi, Pedram
    Puhong Duan
    Ardabili, Sina Faizollahzadeh
    Salwana, Ely
    Band, Shahab S.
    [J]. MATHEMATICS, 2020, 8 (10)
  • [5] Reinforcement Learning Algorithms and Applications in Healthcare and Robotics: A Comprehensive and Systematic Review
    Al-Hamadani, Mokhaled N. A.
    Fadhel, Mohammed A.
    Alzubaidi, Laith
    Balazs, Harangi
    [J]. SENSORS, 2024, 24 (08)
  • [6] Graph Pooling for Graph Neural Networks: Progress, Challenges, and Opportunities
    Liu, Chuang
    Zhan, Yibing
    Wu, Jia
    Li, Chang
    Du, Bo
    Hu, Wenbin
    Liu, Tongliang
    Tao, Dacheng
    [J]. PROCEEDINGS OF THE THIRTY-SECOND INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2023, 2023, : 6712 - 6722
  • [7] Deep reinforcement learning guided graph neural networks for brain network analysis
    Zhao, Xusheng
    Wu, Jia
    Peng, Hao
    Beheshti, Amin
    Monaghan, Jessica J. M.
    McAlpine, David
    Hernandez-Perez, Heivet
    Dras, Mark
    Dai, Qiong
    Li, Yangyang
    Yu, Philip S.
    He, Lifang
    [J]. NEURAL NETWORKS, 2022, 154 : 56 - 67
  • [8] A Deep Reinforcement Learning Heuristic for SAT based on Antagonist Graph Neural Networks
    Fournier, Thomas
    Lallouet, Arnaud
    Cropsal, Telio
    Glorian, Gael
    Papadopoulos, Alexandre
    Petitet, Antoine
    Perez, Guillaume
    Sekar, Suruthy
    Suijlen, Wijnand
    [J]. 2022 IEEE 34TH INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE, ICTAI, 2022, : 1218 - 1222
  • [9] Combining Deep Reinforcement Learning With Graph Neural Networks for Optimal VNF Placement
    Sun, Penghao
    Lan, Julong
    Li, Junfei
    Guo, Zehua
    Hu, Yuxiang
    [J]. IEEE COMMUNICATIONS LETTERS, 2021, 25 (01) : 176 - 180
  • [10] A review of challenges and solutions in the design and implementation of deep graph neural networks
    Mohi ud din, Aafaq
    Qureshi, Shaima
    [J]. International Journal of Computers and Applications, 2023, 45 (03) : 221 - 230