A deep reinforcement learning algorithm framework for solving multi-objective traveling salesman problem based on feature transformation

被引:0
|
作者
Zhao, Shijie [1 ]
Gu, Shenshen [1 ]
机构
[1] Shanghai Univ, Sch Mechatron Engn & Automation, 99 Shangda Rd, Shanghai 200444, Peoples R China
基金
中国国家自然科学基金;
关键词
Multi-objective traveling salesman problem; Feature transformation; Graph pointer network; Deep reinforcement learning; COMBINATORIAL OPTIMIZATION;
D O I
10.1016/j.neunet.2024.106359
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
As a special type of multi-objective combinatorial optimization problems (MOCOPs), the multi-objective traveling salesman problem (MOTSP) plays an important role in practical fields such as transportation and robot control. However, due to the complexity of its solution space and the conflicts between different objectives, it is difficult to obtain satisfactory solutions in a short time. This paper proposes an end-toend algorithm framework for solving MOTSP based on deep reinforcement learning (DRL). By decomposing strategies, solving MOTSP is transformed into solving multiple single-objective optimization subproblems. Through linear transformation, the features of the MOTSP are combined with the weights of the objective function. Subsequently, a modified graph pointer network (GPN) model is used to solve the decomposed subproblems. Compared with the previous DRL model, the proposed algorithm can solve all the subproblems using only one model without adding weight information as input features. Furthermore, our algorithm can output a corresponding solution for each weight, which increases the diversity of solutions. In order to verify the performance of our proposed algorithm, it is compared with four classical evolutionary algorithms and two DRL algorithms on several MOTSP instances. The comparison shows that our proposed algorithm outperforms the compared algorithms both in terms of training time and the quality of the resulting solutions.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] A Graph Pointer Network-Based Multi-Objective Deep Reinforcement Learning Algorithm for Solving the Traveling Salesman Problem
    Perera, Jeewaka
    Liu, Shih-Hsi
    Mernik, Marjan
    Crepinsek, Matej
    Ravber, Miha
    [J]. MATHEMATICS, 2023, 11 (02)
  • [2] Deep reinforcement learning for multi-objective combinatorial optimization: A case study on multi-objective traveling salesman problem
    Li, Shicheng
    Wang, Feng
    He, Qi
    Wang, Xujie
    [J]. SWARM AND EVOLUTIONARY COMPUTATION, 2023, 83
  • [3] Genetic Algorithm Based Multi-objective Optimization Framework to Solve Traveling Salesman Problem
    George, Tintu
    Amudha, T.
    [J]. ADVANCES IN COMPUTING AND INTELLIGENT SYSTEMS, ICACM 2019, 2020, : 141 - 151
  • [4] A Hybrid Estimation of Distribution Algorithm for Solving the Multi-objective Multiple Traveling Salesman Problem
    Shim, V. A.
    Tan, K. C.
    Tan, K. K.
    [J]. 2012 IEEE CONGRESS ON EVOLUTIONARY COMPUTATION (CEC), 2012,
  • [5] A deep reinforcement learning approach for solving the Traveling Salesman Problem with Drone
    Bogyrbayeva, Aigerim
    Yoon, Taehyun
    Ko, Hanbum
    Lim, Sungbin
    Yun, Hyokun
    Kwon, Changhyun
    [J]. TRANSPORTATION RESEARCH PART C-EMERGING TECHNOLOGIES, 2023, 148
  • [6] A multi-objective deep reinforcement learning framework
    Thanh Thi Nguyen
    Ngoc Duy Nguyen
    Vamplew, Peter
    Nahavandi, Saeid
    Dazeley, Richard
    Lim, Chee Peng
    [J]. ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2020, 96
  • [7] Perturbed Decomposition Algorithm applied to the multi-objective Traveling Salesman Problem
    Cornu, Marek
    Cazenave, Tristan
    Vanderpooten, Daniel
    [J]. COMPUTERS & OPERATIONS RESEARCH, 2017, 79 : 314 - 330
  • [8] Multi-objective chemical reaction optimization based decomposition for multi-objective traveling salesman problem
    Bouzoubia, Samira
    Layeb, Abdesslem
    Chikhi, Salim
    [J]. PROCEEDINGS OF 2015 THIRD IEEE WORLD CONFERENCE ON COMPLEX SYSTEMS (WCCS), 2015,
  • [9] A novel multi-objective evolutionary algorithm based on subpopulations for the bi-objective traveling salesman problem
    Moraes, Deyvid Heric
    Sanches, Danilo Sipoli
    Rocha, Josimar da Silva
    Caldonazzo Garbelini, Jader Maikol
    Castoldi, Marcelo Favoretto
    [J]. SOFT COMPUTING, 2019, 23 (15) : 6157 - 6168
  • [10] A novel multi-objective evolutionary algorithm based on subpopulations for the bi-objective traveling salesman problem
    Deyvid Heric Moraes
    Danilo Sipoli Sanches
    Josimar da Silva Rocha
    Jader Maikol Caldonazzo Garbelini
    Marcelo Favoretto Castoldi
    [J]. Soft Computing, 2019, 23 : 6157 - 6168