Monocular Vision SLAM-Based UAV Autonomous Landing in Emergencies and Unknown Environments

被引:71
|
作者
Yang, Tao [1 ,2 ]
Li, Peiqi [1 ]
Zhang, Huiming [3 ]
Li, Jing [4 ]
Li, Zhi [1 ]
机构
[1] Northwestern Polytech Univ, Sch Comp Sci, SAIIP, Xian 710072, Shaanxi, Peoples R China
[2] Northwestern Polytech Univ Shenzhen, Inst Res & Dev, Shenzhen 518057, Peoples R China
[3] Nanjing Univ, Natl Key Lab Novel Software Technol, Nanjing 210023, Jiangsu, Peoples R China
[4] Xidian Univ, Sch Telecommun Engn, Xian 710071, Shaanxi, Peoples R China
基金
中国国家自然科学基金;
关键词
UAV automatic landing; monocular visual SLAM; autonomous landing area selection; MOVING PLATFORM;
D O I
10.3390/electronics7050073
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the popularization and wide application of drones in military and civilian fields, the safety of drones must be considered. At present, the failure and drop rates of drones are still much higher than those of manned aircraft. Therefore, it is imperative to improve the research on the safe landing and recovery of drones. However, most drone navigation methods rely on global positioning system (GPS) signals. When GPS signals are missing, these drones cannot land or recover properly. In fact, with the help of optical equipment and image recognition technology, the position and posture of the drone in three dimensions can be obtained, and the environment where the drone is located can be perceived. This paper proposes and implements a monocular vision-based drone autonomous landing system in emergencies and in unstructured environments. In this system, a novel map representation approach is proposed that combines three-dimensional features and a mid-pass filter to remove noise and construct a grid map with different heights. In addition, a region segmentation is presented to detect the edges of different-height grid areas for the sake of improving the speed and accuracy of the subsequent landing area selection. As a visual landing technology, this paper evaluates the proposed algorithm in two tasks: scene reconstruction integrity and landing location security. In these tasks, firstly, a drone scans the scene and acquires key frames in the monocular visual simultaneous localization and mapping (SLAM) system in order to estimate the pose of the drone and to create a three-dimensional point cloud map. Then, the filtered three-dimensional point cloud map is converted into a grid map. The grid map is further divided into different regions to select the appropriate landing zone. Thus, it can carry out autonomous route planning. Finally, when it stops upon the landing field, it will start the descent mode near the landing area. Experiments in multiple sets of real scenes show that the environmental awareness and the landing area selection have high robustness and real-time performance.
引用
收藏
页数:18
相关论文
共 50 条
  • [1] A semantic SLAM-based method for navigation and landing of UAVs in indoor environments
    Yang, Linjie
    Ye, Jing
    Zhang, Yuan
    Wang, Luping
    Qiu, Changzhen
    KNOWLEDGE-BASED SYSTEMS, 2024, 293
  • [2] Real-Time Monocular Vision System for UAV Autonomous Landing in Outdoor Low-Illumination Environments
    Lin, Shanggang
    Jin, Lianwen
    Chen, Ziwei
    SENSORS, 2021, 21 (18)
  • [3] Monocular Vision-Based Autonomous Navigation System on a Toy Quadcopter in Unknown Environments
    Huang, Rui
    Tan, Ping
    Chen, Ben M.
    2015 INTERNATIONAL CONFERENCE ON UNMANNED AIRCRAFT SYSTEMS (ICUAS'15), 2015, : 1260 - 1269
  • [4] Monocular Vision Aided Autonomous UAV Navigation in Indoor Corridor Environments
    Padhy, Ram Prasad
    Xia, Feng
    Choudhury, Suman Kumar
    Sa, Pankaj Kumar
    Bakshi, Sambit
    IEEE TRANSACTIONS ON SUSTAINABLE COMPUTING, 2019, 4 (01): : 96 - 108
  • [5] Vision-Based Autonomous Landing for the UAV: A Review
    Xin, Long
    Tang, Zimu
    Gai, Weiqi
    Liu, Haobo
    AEROSPACE, 2022, 9 (11)
  • [6] UAV Autonomous landing algorithm based on machine vision
    Xu, Cheng
    Tang, Yuanheng
    Liang, Zuotang
    Yin, Hao
    PROCEEDINGS OF 2018 IEEE 4TH INFORMATION TECHNOLOGY AND MECHATRONICS ENGINEERING CONFERENCE (ITOEC 2018), 2018, : 824 - 829
  • [7] Autonomous Takeoff, Tracking and Landing of a UAV on a Moving UGV Using Onboard Monocular Vision
    Cheng Hui
    Chen Yousheng
    Li Xiaokun
    Wong Wing Shing
    2013 32ND CHINESE CONTROL CONFERENCE (CCC), 2013, : 5895 - 5901
  • [8] Autonomous landing and ingress of micro-air-vehicles in urban environments based on monocular vision.
    Brockers, Roland
    Bouffard, Patrick
    Ma, Jeremy
    Matthies, Larry
    Tomlin, Claire
    MICRO- AND NANOTECHNOLOGY SENSORS, SYSTEMS, AND APPLICATIONS III, 2011, 8031
  • [9] Stereo vision SLAM-based 3D reconstruction on UAV development platforms
    Ding, Chenglong
    Dai, Yunfeng
    Feng, Xingming
    Zhou, Yaqin
    Li, Qingwu
    JOURNAL OF ELECTRONIC IMAGING, 2023, 32 (01)
  • [10] Autonomous Vision Based Landing Strategy for a Rotary Wing UAV
    Grobler, P. R.
    Jordaan, H. W.
    2020 INTERNATIONAL SAUPEC/ROBMECH/PRASA CONFERENCE, 2020, : 232 - 237