A real-time visual compass from two planes for indoor unmanned aerial vehicles (UAVs)

被引:5
|
作者
Wang, Gelin [1 ,2 ]
Qiu, Guoting [2 ]
Zhao, Weiduo [1 ]
Chen, Xinmin [2 ]
Li, Jing [1 ]
机构
[1] Univ Nottingham Ningbo China, Key Lab More Elect Aircraft Technol Zhejiang Prov, Ningbo 315100, Zhejiang, Peoples R China
[2] Chinese Acad Sci, Ningbo Inst Mat Technol & Engn, Special Aircrafts Zhejiang Prov Engn Res Ctr, Ningbo 315100, Zhejiang, Peoples R China
关键词
Visual compass; RGB-D camera; Real-time; Indoor UAV; Manhattan World; ALGORITHMS;
D O I
10.1016/j.eswa.2023.120390
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Improving the accuracy of pose determination of UAVs in a Global Positioning System-denied (GPS-denied) indoor environment, visual Simultaneous Localization And Mapping (vSLAM) techniques have attracted more attention from scholars. RGB-D (Red Green Blue-Depth) camera is a widely used visual sensor as it can recognize unknown environments and behave accordingly, which is valuable for UAVs. However, high computational resources are often required in featureless and uncharacteristic indoor environments to achieve the robust performance of pose decisiveness. To solve this challenge, this paper presents a novel real-time visual compass to estimate the three Degree-of-Freedom (DoF) relative orientations of an RGB-D camera, where the surface-normals-based RANdom Sample Consensus Model (RANSAC) is integrated. In addition, the Manhattan World (MW) assumption is exploited to simplify perception tasks by giving a way of probabilistically modeling background clutter. The effectiveness of the proposed estimator is comprehensively evaluated based on depth datasets from different indoor man-made scenes. And a universal parameter setting of the model is determined. The experiments demonstrated the effectiveness of the visual compass with an average absolute rotation error under 2 degrees. Additionally, the average time needed by the algorithm to process an image frame is under 20 ms, satisfying real-time requirements. The robust achievement by both accuracy and timing indicates that our outperformed state-of-the-art approaches can be more conducive to indoor UAV design.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] Real-time Obstacle Avoidance for Unmanned Aerial Vehicles (UAVs)
    Jayaweera, Herath M. P. C.
    Hanoun, Samer
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2021, : 2622 - 2627
  • [2] A REAL-TIME VISUAL TRACKING FOR UNMANNED AERIAL VEHICLES WITH DYNAMIC WINDOW
    Zhang, Jia
    Chen, Tianrun
    Shi, Zhiguo
    [J]. 2020 CHINA SEMICONDUCTOR TECHNOLOGY INTERNATIONAL CONFERENCE 2020 (CSTIC 2020), 2020,
  • [3] Hybrid real-time stereo visual odometry for unmanned aerial vehicles
    Liu, Yang
    Wang, Congqing
    [J]. OPTICAL ENGINEERING, 2018, 57 (07)
  • [4] Real-Time Hovering Control of Unmanned Aerial Vehicles
    Acosta Lua, Cuauhtemoc
    Vaca Garcia, Claudia Carolina
    Di Gennaro, Stefano
    Castillo-Toledo, B.
    Sanchez Morales, Maria Eugenia
    [J]. MATHEMATICAL PROBLEMS IN ENGINEERING, 2020, 2020
  • [5] OpenREALM: Real-time Mapping for Unmanned Aerial Vehicles
    Kern, Alexander
    Bobbe, Markus
    Khedar, Yogesh
    Bestmann, Ulf
    [J]. 2020 INTERNATIONAL CONFERENCE ON UNMANNED AIRCRAFT SYSTEMS (ICUAS'20), 2020, : 902 - 911
  • [6] Real-Time Virtual Reality Visualizer for Unmanned Aerial Vehicles
    Chicaiza, Fernando A.
    Gallardo, Cristian
    Carvajal, Christian P.
    Quevedo, Washington X.
    Santana, Jaime
    Morales, Vicente
    Andaluz, Victor H.
    [J]. AUGMENTED REALITY, VIRTUAL REALITY, AND COMPUTER GRAPHICS, AVR 2018, PT II, 2018, 10851 : 479 - 495
  • [7] Real-Time Multi-Target Localization from Unmanned Aerial Vehicles
    Wang, Xuan
    Liu, Jinghong
    Zhou, Qianfei
    [J]. SENSORS, 2017, 17 (01):
  • [8] A Real-Time Method to Detect and Track Moving Objects (DATMO) from Unmanned Aerial Vehicles (UAVs) Using a Single Camera
    Rodriguez-Canosa, Gonzalo R.
    Thomas, Stephen
    del Cerro, Jaime
    Barrientos, Antonio
    MacDonald, Bruce
    [J]. REMOTE SENSING, 2012, 4 (04) : 1090 - 1111
  • [9] Real-time aerial video exploitation station for small unmanned aerial vehicles
    Gregga, Jason B.
    Pope, Art
    Kielmeyer, Kathy
    Ran, Yang
    [J]. AIRBORNE INTELLIGENCE, SURVEILLANCE, RECONNAISSANCE (ISR) SYSTEMS AND APPLICATIONS V, 2008, 6946
  • [10] Real-Time Optimal States Estimation with Inertial and Delayed Visual Measurements for Unmanned Aerial Vehicles
    Sun, Xinxin
    Zhang, Chi
    Zou, Le
    Li, Shanhong
    [J]. SENSORS, 2023, 23 (22)