A Binocular Vision-Assisted Method for the Accurate Positioning and Landing of Quadrotor UAVs

被引:0
|
作者
Yang, Jie [1 ]
He, Kunling [2 ]
Zhang, Jie [3 ]
Li, Jiacheng [4 ]
Chen, Qian [2 ]
Wei, Xiaohui [1 ]
Sheng, Hanlin [2 ]
机构
[1] Nanjing Univ Aeronaut & Astronaut NUAA, Coll Aerosp Engn, Nanjing 210016, Peoples R China
[2] Nanjing Univ Aeronaut & Astronaut NUAA, Coll Energy & Power Engn, Nanjing 210016, Peoples R China
[3] Nanjing Univ Aeronaut & Astronaut NUAA, Coll Automat Engn, Nanjing 210016, Peoples R China
[4] Nanjing Univ Aeronaut & Astronaut NUAA, Coll Gen Aviat & Flight, Nanjing 210016, Peoples R China
基金
中国国家自然科学基金;
关键词
visual servoing; target recognition; autonomous landing; Apriltag fiducial system; model predictive control (MPC);
D O I
10.3390/drones9010035
中图分类号
TP7 [遥感技术];
学科分类号
081102 ; 0816 ; 081602 ; 083002 ; 1404 ;
摘要
This paper introduces a vision-based target recognition and positioning system for UAV mobile landing scenarios, addressing challenges such as target occlusion due to shadows and the loss of the field of view. A novel image preprocessing technique is proposed, utilizing finite adaptive histogram equalization in the HSV color space, to enhance UAV recognition and the detection of markers under shadow conditions. The system incorporates a Kalman filter-based target motion state estimation method and a binocular vision-based depth camera target height estimation method to achieve precise positioning. To tackle the problem of poor controller performance affecting UAV tracking and landing accuracy, a feedforward model predictive control (MPC) algorithm is integrated into a mobile landing control method. This enables the reliable tracking of both stationary and moving targets via the UAV. Additionally, with a consideration of the complexities of real-world flight environments, a mobile tracking and landing control strategy based on airspace division is proposed, significantly enhancing the success rate and safety of UAV mobile landings. The experimental results demonstrate a 100% target recognition success rate and high positioning accuracy, with x and y-axis errors not exceeding 0.01 m in close range, the x-axis relative error not exceeding 0.05 m, and the y-axis error not exceeding 0.03 m in the medium range. In long-range situations, the relative errors for both axes do not exceed 0.05 m. Regarding tracking accuracy, both KF and EKF exhibit good following performance with small steady-state errors when the target is stationary. Under dynamic conditions, EKF outperforms KF with better estimation results and a faster tracking speed. The landing accuracy is within 0.1 m, and the proposed method successfully accomplishes the mobile energy supply mission for the vehicle-mounted UAV system.
引用
收藏
页数:32
相关论文
共 48 条
  • [41] Vehicle door frame positioning method for binocular vision robots based on improved YOLOv4
    Song, Limei
    Wang, Yulin
    Yang, Yangang
    Zhu, Xinjun
    MEASUREMENT SCIENCE AND TECHNOLOGY, 2023, 34 (06)
  • [42] Study for straight outdoor vent-pipe positioning method of automobile based on binocular vision system
    Deng, Tinmin
    Liu, Jianxun
    Lu, Baichuan
    PROCEEDINGS OF THE INTERNATIONAL CONFERENCE INFORMATION COMPUTING AND AUTOMATION, VOLS 1-3, 2008, : 1123 - 1126
  • [43] Vision-based UAV Positioning Method Assisted by Relative Attitude Classification
    Zhang, Sheng
    Li, Jie
    Yang, Chengwei
    Yang, Yu
    Hu, Xiaolin
    2020 5TH INTERNATIONAL CONFERENCE ON MATHEMATICS AND ARTIFICIAL INTELLIGENCE (ICMAI 2020), 2020, : 154 - 160
  • [44] An Accurate Linear Method for 3D Line Reconstruction for Binocular or Multiple View Stereo Vision
    Zhong, Lijun
    Qin, Junyou
    Yang, Xia
    Zhang, Xiaohu
    Shang, Yang
    Zhang, Hongliang
    Yu, Qifeng
    SENSORS, 2021, 21 (02) : 1 - 19
  • [45] TOF-assisted binocular vision accuracy improvement method for underwater fish size inspection
    Xiu, Lixin
    Yu, Xinning
    Zhou, Hongguang
    Zhang, Lin
    Wu, Shencheng
    Liang, Ying
    Bi, Yunfeng
    JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A-OPTICS IMAGE SCIENCE AND VISION, 2023, 40 (10) : 1841 - 1848
  • [46] Zigbee wireless network-based indoor mobile robot monitoring and positioning method under binocular vision
    Chen, Xiaowei
    Le, Quoc Tien
    Saedudin, Rd Rohmat
    International Journal of Mechatronics and Applied Mechanics, 2020, 2 (08): : 47 - 53
  • [47] A novel accurate positioning method for object pose estimation in robotic manipulation based on vision and tactile sensors
    Dan Zhao
    Fuchun Sun
    Zongtao Wang
    Quan Zhou
    The International Journal of Advanced Manufacturing Technology, 2021, 116 : 2999 - 3010
  • [48] A novel accurate positioning method for object pose estimation in robotic manipulation based on vision and tactile sensors
    Zhao, Dan
    Sun, Fuchun
    Wang, Zongtao
    Zhou, Quan
    INTERNATIONAL JOURNAL OF ADVANCED MANUFACTURING TECHNOLOGY, 2021, 116 (9-10): : 2999 - 3010