Deep Graph Reinforcement Learning for Solving Multicut Problem

被引:0
|
作者
Li, Zhenchen [1 ,2 ]
Yang, Xu [3 ,4 ]
Zhang, Yanchao [1 ,2 ]
Zeng, Shaofeng [3 ]
Yuan, Jingbin [1 ,4 ]
Liu, Jiazheng [1 ,2 ]
Liu, Zhiyong [3 ,4 ]
Han, Hua [1 ,2 ]
机构
[1] Chinese Acad Sci, Inst Automat, Key Lab Brain Cognit & Brain Inspired Intelligence, Beijing 100190, Peoples R China
[2] Univ Chinese Acad Sci, Sch Future Technol, Beijing 101408, Peoples R China
[3] Chinese Acad Sci, Inst Automation, State Key Lab Multimodal Artificial Intelligence S, Beijing 100190, Peoples R China
[4] Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing 100049, Peoples R China
基金
中国国家自然科学基金;
关键词
Reinforcement learning; Optimization; Feature extraction; Decision making; Costs; Space exploration; Polynomials; Combinatorial optimization; graph neural network; graph partitioning; heuristic algorithm; multicut problem; reinforcement learning; SEGMENTATION; FACETS;
D O I
10.1109/TNNLS.2024.3443413
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The multicut problem, also known as correlation clustering, is a classic combinatorial optimization problem that aims to optimize graph partitioning given only node (dis)similarities on edges. It serves as an elegant generalization for several graph partitioning problems and has found successful applications in various areas such as data mining and computer vision. However, the multicut problem with an exponentially large number of cycle constraints proves to be NP-hard, and existing solvers either suffer from exponential complexity or often give unsatisfactory solutions due to inflexible heuristics driven by hand-designed mechanisms. In this article, we propose a deep graph reinforcement learning method to solve the multicut problem within a combinatorial decision framework involving sequential edge contractions. The customized subgraph neural network adapts to the dynamically edge-contracted graph environment by extracting bilevel connected features from both contracted and original graphs. Our method can learn to infer feasible multicut solutions end-to-end toward optimization of the multicut objective in a data-driven manner. More specifically, by exploring the decision space adaptively, it implicitly gains heuristic knowledge from topological patterns of instances and thereby generates more targeted heuristics overcoming the short-sightedness inherent in the hand-designed ones. During testing, the learned heuristics iteratively contract graphs to construct high-quality solutions within polynomial time. Extensive experiments on synthetic and real-world multicut instances show the superiority of our method over existing combinatorial solvers, while also maintaining a certain level of out-of-distribution generalization ability.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] Deep Reinforcement Learning for Solving AGVs Routing Problem
    Lu, Chengxuan
    Long, Jinjun
    Xing, Zichao
    Wu, Weimin
    Gu, Yong
    Luo, Jiliang
    Huang, Yisheng
    [J]. VERIFICATION AND EVALUATION OF COMPUTER AND COMMUNICATION SYSTEMS, VECOS 2020, 2020, 12519 : 222 - 236
  • [2] Solving Permutation Flowshop Problem with Deep Reinforcement Learning
    Pan, Ruyuan
    Dong, Xingye
    Han, Sheng
    [J]. 2020 PROGNOSTICS AND SYSTEM HEALTH MANAGEMENT CONFERENCE (PHM-BESANCON 2020), 2020, : 349 - 353
  • [3] Deep reinforcement learning for solving the single container loading problem
    Hajlaoui, Yakin
    Jaoua, Amel
    Layeb, Safa Bhar
    [J]. ENGINEERING OPTIMIZATION, 2023, 55 (04) : 668 - 684
  • [4] Solving the train dispatching problem via deep reinforcement learning
    Agasucci, Valerio
    Grani, Giorgio
    Lamorgese, Leonardo
    [J]. JOURNAL OF RAIL TRANSPORT PLANNING & MANAGEMENT, 2023, 26
  • [5] Solving the online batching problem using deep reinforcement learning
    Cals, Bram
    Zhang, Yingqian
    Dijkman, Remco
    van Dorst, Claudy
    [J]. COMPUTERS & INDUSTRIAL ENGINEERING, 2021, 156
  • [6] G-DGANet: Gated deep graph attention network with reinforcement learning for solving traveling salesman problem
    Fellek, Getu
    Farid, Ahmed
    Fujimura, Shigeru
    Yoshie, Osamu
    Gebreyesus, Goytom
    [J]. NEUROCOMPUTING, 2024, 579
  • [7] G-DGANet: Gated deep graph attention network with reinforcement learning for solving traveling salesman problem
    Fellek, Getu
    Farid, Ahmed
    Fujimura, Shigeru
    Yoshie, Osamu
    Gebreyesus, Goytom
    [J]. Neurocomputing, 2024, 579
  • [8] Deep reinforcement learning algorithm for solving material emergency dispatching problem
    Jiang, Huawei
    Guo, Tao
    Yang, Zhen
    Zhao, Like
    [J]. MATHEMATICAL BIOSCIENCES AND ENGINEERING, 2022, 19 (11) : 10864 - 10881
  • [9] Solving the Traveling Salesperson Problem with Precedence Constraints by Deep Reinforcement Learning
    Loewens, Christian
    Ashraf, Inaam
    Gembus, Alexander
    Cuizon, Genesis
    Falkner, Jonas K.
    Schmidt-Thieme, Lars
    [J]. ADVANCES IN ARTIFICIAL INTELLIGENCE, KI 2022, 2022, 13404 : 160 - 172
  • [10] A deep reinforcement learning approach for solving the Traveling Salesman Problem with Drone
    Bogyrbayeva, Aigerim
    Yoon, Taehyun
    Ko, Hanbum
    Lim, Sungbin
    Yun, Hyokun
    Kwon, Changhyun
    [J]. TRANSPORTATION RESEARCH PART C-EMERGING TECHNOLOGIES, 2023, 148