Real-time Onboard 6DoF Localization of an Indoor MAV in Degraded Visual Environments Using a RGB-D Camera

被引:0
|
作者
Fang, Zheng [1 ]
Scherer, Sebastian [2 ]
机构
[1] Northeastern Univ, State Key Lab Synthet Automat Proc Ind, Shenyang 110189, Peoples R China
[2] Carnegie Mellon Univ, Inst Robot, Pittsburgh, PA 15213 USA
关键词
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Real-time and reliable localization is a prerequisite for autonomously performing high-level tasks with micro aerial vehicles(MAVs). Nowadays, most existing methods use vision system for 6DoF pose estimation, which can not work in degraded visual environments. This paper presents an onboard 6DoF pose estimation method for an indoor MAV in challenging GPS-denied degraded visual environments by using a RGB-D camera. In our system, depth images are mainly used for odometry estimation and localization. First, a fast and robust relative pose estimation (6DoF Odometry) method is proposed, which uses the range rate constraint equation and photometric error metric to get the frame-to-frame transform. Then, an absolute pose estimation (6DoF Localization) method is proposed to locate the MAV in a given 3D global map by using a particle filter. The whole localization system can run in real-time on an embedded computer with low CPU usage. We demonstrate the effectiveness of our system in extensive real environments on a customized MAV platform. The experimental results show that our localization system can robustly and accurately locate the robot in various practical challenging environments.
引用
下载
收藏
页码:5253 / 5259
页数:7
相关论文
共 50 条
  • [31] Toward autonomous navigation using an RGB-D camera for flight in unknown indoor environments
    Tang, Liangwen
    Yang, Sheng
    Cheng, Nong
    Li, Qing
    2014 IEEE CHINESE GUIDANCE, NAVIGATION AND CONTROL CONFERENCE (CGNCC), 2014, : 2007 - 2012
  • [32] Towards Real-time Semantic RGB-D SLAM in Dynamic Environments
    Ji, Tete
    Wang, Chen
    Xie, Lihua
    2021 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2021), 2021, : 11175 - 11181
  • [33] Real-Time Localization of Mobile Robots in Indoor Environments Using a Ceiling Camera Structure
    Nascimento, Rafaella C. A.
    Silva, Bruno M. F.
    Goncalves, Luiz M. G.
    2013 IEEE LATIN AMERICAN ROBOTICS SYMPOSIUM (LARS 2013), 2013, : 61 - 66
  • [34] Research on real time 6DOF robot localization based on visual and inertial fusion
    Zheng, Xinfang
    Guo, Yongxiang
    PROCEEDINGS OF THE 2017 5TH INTERNATIONAL CONFERENCE ON MACHINERY, MATERIALS AND COMPUTING TECHNOLOGY (ICMMCT 2017), 2017, 126 : 1431 - 1441
  • [35] Real-Time Visual Odometry from Dense RGB-D Images
    Steinbruecker, Frank
    Sturm, Juergen
    Cremers, Daniel
    2011 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCV WORKSHOPS), 2011,
  • [36] Research on real time 6DOF robot localization based on visual and inertial fusion
    Zheng, Xinfang
    Guo, Yongxiang
    PROCEEDINGS OF THE 2017 5TH INTERNATIONAL CONFERENCE ON MACHINERY, MATERIALS AND COMPUTING TECHNOLOGY (ICMMCT 2017), 2017, 126 : 1392 - 1402
  • [37] Robust Real-Time Visual Odometry for Dense RGB-D Mapping
    Whelan, Thomas
    Johannsson, Hordur
    Kaess, Michael
    Leonard, John J.
    McDonald, John
    2013 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2013, : 5724 - 5731
  • [38] Real-Time RGB-D Camera Pose Estimation in Novel Scenes Using a Relocalisation Cascade
    Cavallari, Tommaso
    Golodetz, Stuart
    Lord, Nicholas A.
    Valentin, Julien
    Prisacariu, Victor A.
    Di Stefano, Luigi
    Torr, Philip H. S.
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2020, 42 (10) : 2465 - 2477
  • [39] YCB-M: A Multi-Camera RGB-D Dataset for Object Recognition and 6DoF Pose Estimation
    Grenzdoerffer, Till
    Guenther, Martin
    Hertzberg, Joachim
    2020 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2020, : 3650 - 3656
  • [40] Semantic Segmentation and 6DoF Pose Estimation using RGB-D Images and Deep Neural Networks
    Van Luan Tran
    Lin, Huei-Yung
    PROCEEDINGS OF 2021 IEEE 30TH INTERNATIONAL SYMPOSIUM ON INDUSTRIAL ELECTRONICS (ISIE), 2021,