Real-time Onboard 6DoF Localization of an Indoor MAV in Degraded Visual Environments Using a RGB-D Camera

被引:0
|
作者
Fang, Zheng [1 ]
Scherer, Sebastian [2 ]
机构
[1] Northeastern Univ, State Key Lab Synthet Automat Proc Ind, Shenyang 110189, Peoples R China
[2] Carnegie Mellon Univ, Inst Robot, Pittsburgh, PA 15213 USA
关键词
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Real-time and reliable localization is a prerequisite for autonomously performing high-level tasks with micro aerial vehicles(MAVs). Nowadays, most existing methods use vision system for 6DoF pose estimation, which can not work in degraded visual environments. This paper presents an onboard 6DoF pose estimation method for an indoor MAV in challenging GPS-denied degraded visual environments by using a RGB-D camera. In our system, depth images are mainly used for odometry estimation and localization. First, a fast and robust relative pose estimation (6DoF Odometry) method is proposed, which uses the range rate constraint equation and photometric error metric to get the frame-to-frame transform. Then, an absolute pose estimation (6DoF Localization) method is proposed to locate the MAV in a given 3D global map by using a particle filter. The whole localization system can run in real-time on an embedded computer with low CPU usage. We demonstrate the effectiveness of our system in extensive real environments on a customized MAV platform. The experimental results show that our localization system can robustly and accurately locate the robot in various practical challenging environments.
引用
下载
收藏
页码:5253 / 5259
页数:7
相关论文
共 50 条
  • [41] Strong-SLAM: real-time RGB-D visual SLAM in dynamic environments based on StrongSORT
    Huang, Wei
    Zou, Chunlong
    Yun, Juntong
    Jiang, Du
    Huang, Li
    Liu, Ying
    Jiang, Guo Zhang
    Xie, Yuanmin
    MEASUREMENT SCIENCE AND TECHNOLOGY, 2024, 35 (12)
  • [42] Robust Real-time RGB-D Visual Odometry in Dynamic Environments via Rigid Motion Model
    Lee, Sangil
    Son, Clark Youngdong
    Kim, H. Jin
    2019 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2019, : 6891 - 6898
  • [43] A Real-Time System for Object Detection and Location Reminding with RGB-D Camera
    Chen, I-Kuei
    Chi, Chung-Yu
    Hsu, Szu-Lu
    Chen, Liang-Gee
    2014 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS (ICCE), 2014, : 414 - 415
  • [44] Real-time reconstruction of pipes using RGB-D cameras
    Kim, Dong-Min
    Ahn, JeongHyeon
    Kim, Seung-wook
    Lee, Jongmin
    Kim, Myungho
    Han, JungHyun
    COMPUTER ANIMATION AND VIRTUAL WORLDS, 2024, 35 (01)
  • [45] A Real-Time Distributed Relative Pose Estimation Algorithm for RGB-D Camera Equipped Visual Sensor Networks
    Wang, Xiaoqin
    Sekercioglu, Y. Ahmet
    Drummond, Tom
    2013 SEVENTH INTERNATIONAL CONFERENCE ON DISTRIBUTED SMART CAMERAS (ICDSC), 2013,
  • [46] Real-Time RGB-D Simultaneous Localization and Mapping Guided by Terrestrial LiDAR Point Cloud for Indoor 3-D Reconstruction and Camera Pose Estimation
    Kang, Xujie
    Li, Jing
    Fan, Xiangtao
    Wan, Wenhui
    APPLIED SCIENCES-BASEL, 2019, 9 (16):
  • [47] 6-DoF Velocity Estimation Using RGB-D Camera Based on Optical Flow
    Kim, Pyojin
    Lim, Hyon
    Kim, H. Jin
    2014 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN AND CYBERNETICS (SMC), 2014, : 4008 - 4013
  • [48] Real-time 3D Object Detection from Point Clouds using an RGB-D Camera
    Wang, Ya
    Xu, Shu
    Zell, Andreas
    ICPRAM: PROCEEDINGS OF THE 9TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION APPLICATIONS AND METHODS, 2020, : 407 - 414
  • [49] Real-Time RGB-D Visual Tracking With Scale Estimation and Occlusion Handling
    Leng, Jiaxu
    Liu, Ying
    IEEE ACCESS, 2018, 6 : 24256 - 24263
  • [50] Real-Time 3D Modeling with a RGB-D Camera and On-Board Processing
    Aguilar, Wilbert G.
    Rodriguez, Guillermo A.
    Alvarez, Leandro
    Sandoval, Sebastian
    Quisaguano, Fernando
    Limaico, Alex
    AUGMENTED REALITY, VIRTUAL REALITY, AND COMPUTER GRAPHICS, AVR 2017, PT II, 2017, 10325 : 410 - 419