Markov Decision Process-based Potential Field Technique for UAV Planning

被引:0
|
作者
Moon, Chaehwan [1 ]
Ahn, Jaemyung [1 ]
机构
[1] Korea Adv Sci Inst Technol, Dept Aerosp Engn, Daejeon 34141, South Korea
关键词
Markov decision process(MDP); Sequential decision-making process; Potential field algorithm; Artificial potential field(APF); Mission planning;
D O I
10.12941/jksiam.2021.25.149
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
This study proposes a methodology for mission/path planning of an unmanned aerial vehicle (UAV) using an artificial potential field with the Markov Decision Process (MDP). The planning problem is formulated as an MDP. A low-resolution solution of the MDP is obtained and used to define an artificial potential field, which provides a continuous UAV mission plan. A numerical case study is conducted to demonstrate the validity of the proposed technique.
引用
收藏
页码:149 / 161
页数:13
相关论文
共 50 条
  • [1] A Markov Decision Process-based approach for trajectory planning with clothoid tentacles
    Mouhagir, Hafida
    Talj, Reine
    Cherfaoui, Veronique
    Guillemard, Franck
    Aioun, Francois
    [J]. 2016 IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV), 2016, : 1254 - 1259
  • [2] A Markov Decision Process-Based Opportunistic Spectral Access
    Arunthavanathan, Senthuran
    Kandeepan, Sithamparanathan
    Evans, Robin. J.
    [J]. IEEE WIRELESS COMMUNICATIONS LETTERS, 2016, 5 (05) : 544 - 547
  • [3] A Markov Decision Process-based handicap system for tennis
    Chan, Timothy C. Y.
    Singal, Raghav
    [J]. JOURNAL OF QUANTITATIVE ANALYSIS IN SPORTS, 2016, 12 (04) : 179 - 189
  • [4] A Markov Decision Process-based Collision Avoidance in IoT Applications
    Djiroun, Fatima Zahra
    Bagaa, Miloud
    Taleb, Tarik
    [J]. GLOBECOM 2017 - 2017 IEEE GLOBAL COMMUNICATIONS CONFERENCE, 2017,
  • [5] Partially observable Markov decision process-based optimal maintenance planning with time-dependent observations
    Deep, Akash
    Zhou, Shiyu
    Veeramani, Dharmaraj
    Chen, Yong
    [J]. EUROPEAN JOURNAL OF OPERATIONAL RESEARCH, 2023, 311 (02) : 533 - 544
  • [6] UAV Path Planning in a Dynamic Environment via Partially Observable Markov Decision Process
    Ragi, Shankarachary
    Chong, Edwin K. P.
    [J]. IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS, 2013, 49 (04) : 2397 - 2412
  • [7] A Markov Decision Process-based Service Migration Procedure for Follow Me Cloud
    Ksentini, Adlen
    Taleb, Tarik
    Chen, Min
    [J]. 2014 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2014, : 1350 - 1354
  • [8] Planning for Target System Striking Based on Markov Decision Process
    Lei Ting
    Zhu Cheng
    Zhang Weiming
    [J]. 2013 IEEE INTERNATIONAL CONFERENCE ON SERVICE OPERATIONS AND LOGISTICS, AND INFORMATICS (SOLI), 2013, : 154 - 159
  • [9] A Semi-Markov Decision Process-Based Computation Offloading Strategy in Vehicular Networks
    Wang, Zhe
    Zhong, Zhangdui
    Ni, Minming
    [J]. 2017 IEEE 28TH ANNUAL INTERNATIONAL SYMPOSIUM ON PERSONAL, INDOOR, AND MOBILE RADIO COMMUNICATIONS (PIMRC), 2017,
  • [10] A Novel Markov Decision Process-Based Solution for Improved Quality Prioritized Video Delivery
    Anedda, Matteo
    Murroni, Maurizio
    Muntean, Gabriel-Miro
    [J]. IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2020, 17 (01): : 592 - 606