MARL-Based Multi-Satellite Intelligent Task Planning Method

被引:4
|
作者
Zhang, Guohui [1 ]
Li, Xinhong [1 ]
Hu, Gangxuan [1 ]
Li, Yanyan [1 ]
Wang, Xun [1 ]
Zhang, Zhibin [1 ]
机构
[1] Space Engn Univ, Dept Aerosp Sci & Technol, Beijing 101416, Peoples R China
关键词
Task analysis; Satellites; Planning; Markov processes; Games; Reinforcement learning; Predictive models; MARL; multi-satellite intelligent task planning; Markov game; MAPPO;
D O I
10.1109/ACCESS.2023.3337358
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this article, we propose a solution to multi-satellite intelligent task planning using the multi-agent reinforcement learning (MARL) method. Fristly, we have developed a multi-satellite task planning model based on the Markov game framework. Furthermore, we have computationally designed a satellite state transition function to address the task planning problem and successfully solved it using the multi-agent proximal policy optimization (MAPPO) algorithm. Our experimental results demonstrate that the MARL method exhibits remarkable convergence speed and performance, delivering significant rewards in multi-scale task planning scenarios. Consequently, it proves to be a highly suitable approach for multi-satellite intelligent task planning.
引用
收藏
页码:135517 / 135528
页数:12
相关论文
共 50 条
  • [21] An interactive method for multi-satellite imaging mission planning in complex environments
    Yang, Xueying
    Hu, Min
    Huang, Gang
    PROCEEDINGS OF THE 36TH CHINESE CONTROL AND DECISION CONFERENCE, CCDC 2024, 2024, : 3593 - 3600
  • [22] Modeling and Solving for Multi-Satellite Cooperative Task Allocation Problem Based on Genetic Programming Method
    Qi, Weihua
    Yang, Wenyuan
    Xing, Lining
    Yao, Feng
    MATHEMATICS, 2022, 10 (19)
  • [23] MARL-Based Cooperative Multi-AGV Control in Warehouse Systems
    Choi, Ho-Bin
    Kim, Ju-Bong
    Han, Youn-Hee
    Oh, Se-Won
    Kim, Kwihoon
    IEEE ACCESS, 2022, 10 : 100478 - 100488
  • [24] Task Allocation for Multi-Satellite Cooperation Based on Estimation of Distribution Algorithm
    Wang Shi-xing
    Wu Jin-hua
    Tian Liang
    PROCEEDINGS OF THE 31ST CHINESE CONTROL CONFERENCE, 2012, : 2548 - 2553
  • [25] Mission planning for joint search by multi-satellite
    College of Information System and Management, NUDT, Changsha 410073, China
    Yuhang Xuebao, 2008, 2 (653-658):
  • [26] A MULTI-SATELLITE REGIONAL IMAGING MISSION PLANNING METHOD BASED ON MOOM FOR EMERGENCY SURVEYING AND MAPPING
    Chen, Yaxin
    Shen, Xin
    Li, Shixue
    Zhang, Guo
    Xu, Miaozhong
    Liu, Yulin
    Xu, Junfei
    2019 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2019), 2019, : 9071 - 9074
  • [27] Multi-satellite Mission Planning Algorithm Based on Preemptive Priority Model
    Gan, Hai-Ping
    Cao, Lin
    Song, Pei-Ran
    Cao, Xiao-Peng
    Du, Bing-Nan
    Du, Kang-Ning
    Guo, Ya-Nan
    Journal of Computers (Taiwan), 2023, 34 (01) : 225 - 238
  • [28] Multi-Satellite Task Allocation Algorithm for Earth Observation
    Sinha, Pratik Kumar
    Dutta, Animesh
    PROCEEDINGS OF THE 2016 IEEE REGION 10 CONFERENCE (TENCON), 2016, : 403 - 408
  • [29] Balancing Efficiency and Unpredictability in Multi-robot Patrolling: A MARL-Based Approach
    Guo, Lingxiao
    Pan, Haoxuan
    Duan, Xiaoming
    He, Jianping
    2023 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, ICRA, 2023, : 3504 - 3509
  • [30] New multi-satellite scheduling method
    Wang, Z., 1600, Chinese Academy of Space Technology (32):