Hierarchical Motion Planning Under Probabilistic Temporal Tasks and Safe-Return Constraints

被引:3
|
作者
Guo, Meng [1 ]
Liao, Tianjun [2 ]
Wang, Junjie [1 ]
Li, Zhongkui [1 ]
机构
[1] Peking Univ, Coll Engn, Dept Mech & Engn Sci, State Key Lab Turbulence & Complex Syst, Beijing 100871, Peoples R China
[2] Peking Univ, Acad Mil Sci, Beijing 100871, Peoples R China
基金
中国国家自然科学基金; 北京市自然科学基金;
关键词
Formal methods; linear temporal logic; Markov decision process (MDP); safety; task and motion planning; MARKOV DECISION-PROCESSES; VERIFICATION;
D O I
10.1109/TAC.2023.3244884
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Safety is crucial for robotic missions within an uncertain environment. Common safety requirements such as collision avoidance are only state-dependent, which can be restrictive for complex missions. In this article, we address a more general formulation as safe-return constraints, which require the existence of a return policy to drive the system back to a set of safe states with high probability. The robot motion is modeled as a Markov decision process with probabilistic labels, which can be highly nonergodic. The robotic task is specified as linear temporal logic formulas over these labels, such as surveillance and transportation. We first provide theoretical guarantees on the reformulation of such safe-return constraints, and a baseline solution based on computing two complete product automata. Furthermore, to tackle the computational complexity, we propose a hierarchical planning algorithm that combines the feature-based symbolic and temporal abstraction with constrained optimization. It synthesizes simultaneously two dependent motion policies: the outbound policy minimizes the overall cost of satisfying the task with a high probability, while the return policy ensures the safe-return constraints. The problem formulation is versatile regarding the robot model, task specifications, and safety constraints. The proposed hierarchical algorithm is more efficient and can solve much larger problems than the baseline solution, with only a slight loss of optimality. Numerical validations include simulations and hardware experiments of a search-and-rescue mission and a planetary exploration mission over various system sizes.
引用
收藏
页码:6727 / 6742
页数:16
相关论文
共 50 条
  • [41] Safe Motion Planning under Partial Observability with an Optimal Deterministic Planner
    Johnson, Jeffrey Kane
    2020 AMERICAN CONTROL CONFERENCE (ACC), 2020, : 689 - 694
  • [42] Reactive Task and Motion Planning under Temporal Logic Specifications
    Li, Shen
    Park, Daehyung
    Sung, Yoonchang
    Shah, Julie A.
    Roy, Nicholas
    2021 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2021), 2021, : 12618 - 12624
  • [43] Synthesizing safe policies under probabilistic constraints with reinforcement learning and Bayesian model checking
    Belzner, Lenz
    Wirsing, Martin
    SCIENCE OF COMPUTER PROGRAMMING, 2021, 206
  • [44] Reinforcement Learning Under Probabilistic Spatio-Temporal Constraints with Time Windows
    Lin, Xiaoshan
    Koochakzadeh, Abbasali
    Yazicio, Yasin
    Aksaray, Derya
    2023 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2023, : 8680 - 8686
  • [45] Probabilistic Plan Recognition for Multi-Agent Systems under Temporal Logic Tasks
    Yu, Wentao
    Li, Shanghao
    Tian, Daiying
    Cui, Jinqiang
    ELECTRONICS, 2022, 11 (09)
  • [46] RAMP: Hierarchical Reactive Motion Planning for Manipulation Tasks Using Implicit Signed Distance Functions
    Vasilopoulos, Vasileios
    Garg, Suveer
    Piacenza, Pedro
    Huh, Jinwook
    Isler, Volkan
    2023 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2023, : 10551 - 10558
  • [47] Specific Tracking Control of Rotating Target Spacecraft Under Safe Motion Constraints
    Lin, Zijie
    Wu, Baolin
    Wang, Danwei
    IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS, 2023, 59 (03) : 2422 - 2438
  • [48] OncoTheraper: Clinical Decision Support for Oncology Therapy Planning Based on Temporal Hierarchical Tasks Networks
    Fdez-Olivares, Juan
    Cozar, Juan A.
    Castillo, Luis
    KNOWLEDGE MANAGEMENT FOR HEALTH CARE PROCEDURES, 2009, 5626 : 25 - +
  • [49] Efficient Sampling of Transition Constraints for Motion Planning under Sliding Contacts
    Khoury, Marie-Therese
    Orthey, Andreas
    Toussaint, Marc
    2021 IEEE 17TH INTERNATIONAL CONFERENCE ON AUTOMATION SCIENCE AND ENGINEERING (CASE), 2021, : 1547 - 1553
  • [50] Speed planning method for mobile robots under motion constraints.
    Muñoz, VF
    Cruz, A
    Ollero, A
    Garcia-Cerezo, A
    INTELLIGENT AUTONOMOUS VECHICLES 1998 (IAV'98), 1998, : 123 - 128