A Binocular Vision-Assisted Method for the Accurate Positioning and Landing of Quadrotor UAVs

被引:0
|
作者
Yang, Jie [1 ]
He, Kunling [2 ]
Zhang, Jie [3 ]
Li, Jiacheng [4 ]
Chen, Qian [2 ]
Wei, Xiaohui [1 ]
Sheng, Hanlin [2 ]
机构
[1] Nanjing Univ Aeronaut & Astronaut NUAA, Coll Aerosp Engn, Nanjing 210016, Peoples R China
[2] Nanjing Univ Aeronaut & Astronaut NUAA, Coll Energy & Power Engn, Nanjing 210016, Peoples R China
[3] Nanjing Univ Aeronaut & Astronaut NUAA, Coll Automat Engn, Nanjing 210016, Peoples R China
[4] Nanjing Univ Aeronaut & Astronaut NUAA, Coll Gen Aviat & Flight, Nanjing 210016, Peoples R China
基金
中国国家自然科学基金;
关键词
visual servoing; target recognition; autonomous landing; Apriltag fiducial system; model predictive control (MPC);
D O I
10.3390/drones9010035
中图分类号
TP7 [遥感技术];
学科分类号
081102 ; 0816 ; 081602 ; 083002 ; 1404 ;
摘要
This paper introduces a vision-based target recognition and positioning system for UAV mobile landing scenarios, addressing challenges such as target occlusion due to shadows and the loss of the field of view. A novel image preprocessing technique is proposed, utilizing finite adaptive histogram equalization in the HSV color space, to enhance UAV recognition and the detection of markers under shadow conditions. The system incorporates a Kalman filter-based target motion state estimation method and a binocular vision-based depth camera target height estimation method to achieve precise positioning. To tackle the problem of poor controller performance affecting UAV tracking and landing accuracy, a feedforward model predictive control (MPC) algorithm is integrated into a mobile landing control method. This enables the reliable tracking of both stationary and moving targets via the UAV. Additionally, with a consideration of the complexities of real-world flight environments, a mobile tracking and landing control strategy based on airspace division is proposed, significantly enhancing the success rate and safety of UAV mobile landings. The experimental results demonstrate a 100% target recognition success rate and high positioning accuracy, with x and y-axis errors not exceeding 0.01 m in close range, the x-axis relative error not exceeding 0.05 m, and the y-axis error not exceeding 0.03 m in the medium range. In long-range situations, the relative errors for both axes do not exceed 0.05 m. Regarding tracking accuracy, both KF and EKF exhibit good following performance with small steady-state errors when the target is stationary. Under dynamic conditions, EKF outperforms KF with better estimation results and a faster tracking speed. The landing accuracy is within 0.1 m, and the proposed method successfully accomplishes the mobile energy supply mission for the vehicle-mounted UAV system.
引用
收藏
页数:32
相关论文
共 48 条
  • [1] Combination Navigation and Positioning Method for Binocular Vision Assisted PDR
    He J.-Y.
    Wu M.-X.
    Song C.
    Zhang M.
    Zhang J.-N.
    Tien Tzu Hsueh Pao/Acta Electronica Sinica, 2023, 51 (03): : 736 - 745
  • [2] Vision-Assisted Landing Method for Unmanned Powered Parachute Vehicle Based on Lightweight Neural Network
    Zhang, Mengxuan
    Hu, Wei
    Ji, Shude
    Song, Qi
    Gong, Peng
    Kong, Lingpei
    IEEE ACCESS, 2021, 9 (09): : 130981 - 130989
  • [3] Accurate positioning method of maritime search and rescue target based on binocular vision
    Luo, Jie
    Dong, Wenhai
    SIGNAL IMAGE AND VIDEO PROCESSING, 2025, 19 (04)
  • [4] Vision-assisted deep stall landing for a fixed-wing UAV
    Kim, Doyoung
    Park, Sanghyuk
    JOURNAL OF FIELD ROBOTICS, 2022, 39 (07) : 1138 - 1152
  • [5] Automated Long-Term Monitoring of Parallel Microfluidic Operations Applying a Machine Vision-Assisted Positioning Method
    Yip, Hon Ming
    Li, John C. S.
    Xie, Kai
    Cui, Xin
    Prasad, Agrim
    Gao, Qiannan
    Leung, Chi Chiu
    Lam, Raymond H. W.
    SCIENTIFIC WORLD JOURNAL, 2014,
  • [6] Bolt positioning method based on active binocular vision
    Jian, Xu
    Chen, Xin
    Xiao, Zhe
    Sun, Yipu
    PROCEEDINGS OF THE 38TH CHINESE CONTROL CONFERENCE (CCC), 2019, : 7057 - 7062
  • [7] Binocular Vision-Assisted Magnetic Soft Catheter Robot System for Minimally Invasive in-Situ Bioprinting
    Hu, Jiarong
    Guo, Liwen
    Gu, Wangxie
    Hu, Jiaying
    Liu, An
    He, Yong
    Fu, Jianzhong
    Hu, Songyu
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2024, 9 (12): : 11130 - 11137
  • [8] Optical positioning technology of an assisted puncture robot based on binocular vision
    Jiang, Guanwu
    Luo, Minzhou
    Bai, Keqiang
    INTERNATIONAL JOURNAL OF IMAGING SYSTEMS AND TECHNOLOGY, 2019, 29 (02) : 180 - 190
  • [9] Research on Autonomous Positioning Method of UAV Based on Binocular Vision
    Wang Jingjing
    Gu De
    Liu Fei
    2019 CHINESE AUTOMATION CONGRESS (CAC2019), 2019, : 3588 - 3593
  • [10] Binocular Vision Positioning Method for Safety Monitoring of Solitary Elderly
    Zhu, Lihua
    Zhang, Yan
    Wang, Yu
    Cheng, Cheire
    CMC-COMPUTERS MATERIALS & CONTINUA, 2022, 71 (01): : 593 - 609