MARL-Based Multi-Satellite Intelligent Task Planning Method

被引:4
|
作者
Zhang, Guohui [1 ]
Li, Xinhong [1 ]
Hu, Gangxuan [1 ]
Li, Yanyan [1 ]
Wang, Xun [1 ]
Zhang, Zhibin [1 ]
机构
[1] Space Engn Univ, Dept Aerosp Sci & Technol, Beijing 101416, Peoples R China
关键词
Task analysis; Satellites; Planning; Markov processes; Games; Reinforcement learning; Predictive models; MARL; multi-satellite intelligent task planning; Markov game; MAPPO;
D O I
10.1109/ACCESS.2023.3337358
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this article, we propose a solution to multi-satellite intelligent task planning using the multi-agent reinforcement learning (MARL) method. Fristly, we have developed a multi-satellite task planning model based on the Markov game framework. Furthermore, we have computationally designed a satellite state transition function to address the task planning problem and successfully solved it using the multi-agent proximal policy optimization (MAPPO) algorithm. Our experimental results demonstrate that the MARL method exhibits remarkable convergence speed and performance, delivering significant rewards in multi-scale task planning scenarios. Consequently, it proves to be a highly suitable approach for multi-satellite intelligent task planning.
引用
收藏
页码:135517 / 135528
页数:12
相关论文
共 50 条
  • [31] Role-Based Access Control in Multi-Satellite Planning System
    Zhu, Jiajia
    Li, Ziyang
    Liu, Zhe
    Wu, Hao
    2011 INTERNATIONAL CONFERENCE ON COMPUTER APPLICATION AND EDUCATION TECHNOLOGY (ICCAET 2011), 2011, : 362 - 364
  • [32] Satellite scheduling engine: The intelligent solver for future multi-satellite management
    Yonghao Du
    Lining Xing
    Yingguo Chen
    Frontiers of Engineering Management, 2022, 9 : 683 - 688
  • [33] Robust Task Scheduling of Multi-Satellite Parallel Test
    Lin Shumin
    Zheng Zheng
    Cai Kai-Yuan
    2011 30TH CHINESE CONTROL CONFERENCE (CCC), 2011, : 2152 - 2157
  • [34] Multi-satellite imaging planning method with optimal response time for emergency tasks
    Chen Shujian
    Li Zhi
    Hu Min
    Zhang Yasheng
    CHINESE SPACE SCIENCE AND TECHNOLOGY, 2020, 40 (02) : 17 - 28
  • [35] Multi-satellite emergency task scheduling with merging mechanism
    Jin P.
    Tang X.
    Xi Tong Gong Cheng Yu Dian Zi Ji Shu/Systems Engineering and Electronics, 2022, 44 (04): : 1270 - 1281
  • [36] Satellite scheduling engine: The intelligent solver for future multi-satellite management
    Du, Yonghao
    Xing, Lining
    Chen, Yingguo
    FRONTIERS OF ENGINEERING MANAGEMENT, 2022, 9 (04) : 683 - 688
  • [37] Satellite scheduling engine:The intelligent solver for future multi-satellite management
    Yonghao DU
    Lining XING
    Yingguo CHEN
    Frontiers of Engineering Management, 2022, (04) : 683 - 688
  • [38] Task Resource Planning and Verification Method Based on Intelligent Planning
    Wang Haiqing
    Peng Sun
    2018 IEEE 18TH INTERNATIONAL CONFERENCE ON SOFTWARE QUALITY, RELIABILITY AND SECURITY COMPANION (QRS-C), 2018, : 371 - 376
  • [39] Distributed onboard mission planning for multi-satellite systems
    Zheng, Zixuan
    Guo, Jian
    Gill, Eberhard
    AEROSPACE SCIENCE AND TECHNOLOGY, 2019, 89 (111-122) : 111 - 122
  • [40] Key Generation Method Based on Multi-Satellite Cooperation and Random Perturbation
    Hao, Yinuo
    Mu, Pengcheng
    Wang, Huiming
    Jin, Liang
    ENTROPY, 2021, 23 (12)