Camera/IMU Calibration Revisited

被引:51
|
作者
Rehder, Joern [1 ]
Siegwart, Roland [1 ]
机构
[1] Swiss Fed Inst Technol, Autonomous Syst Lab, CH-8092 Zurich, Switzerland
关键词
Calibration; sensor fusion; maximum likelihood estimation; robot vision systems; cameras; inertial navigation; KALMAN FILTER;
D O I
10.1109/JSEN.2017.2674307
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
With growing interest in visual/inertial state estimation and an increasing number of approaches and applications emerging for this technology, camera/IMU calibration can be a valuable tool to increase the performance of these methods and to further the understanding of the involved sensor modalities. In this paper, we assess the impact of two different adjustments to the commonly used sensor models. First, we extend the IMU model to take the displacement of individual accelerometer axes into account. We show that especially high quality devices benefit from this extension, since these IMUs often employ separate sensors for each axis. Second, we propose a novel, direct model for the camera measurements that operates on image intensities rather than corner positions. This formulation is capable of explicitly accounting for motion blur and defocus, but it requires significant modeling efforts. Our results demonstrate that the transformation between camera and IMU can be estimated to a precision exceeding 1/5 mm and 1/100 degrees, while temporal offsets are determined to microsecond precision-on data sets of merely 20-s length. At the same time, image exposure time can be inferred to an accuracy of about 2/100 ms from motion blur.
引用
收藏
页码:3257 / 3268
页数:12
相关论文
共 50 条
  • [1] Optimization Based IMU Camera Calibration
    Fleps, Michael
    Mair, Elmar
    Ruepp, Oliver
    Suppa, Michael
    Burschka, Darius
    [J]. 2011 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS, 2011, : 3297 - 3304
  • [2] Online Multi Camera-IMU Calibration
    Hartzer, Jacob
    Saripalli, Srikanth
    [J]. 2022 IEEE INTERNATIONAL SYMPOSIUM ON SAFETY, SECURITY, AND RESCUE ROBOTICS (SSRR), 2022, : 360 - 365
  • [3] Relative Pose Calibration of a Spherical Camera and an IMU
    Hol, Jeroen D.
    Schon, Thomas B.
    Gustafsson, Fredrik
    [J]. 7TH IEEE INTERNATIONAL SYMPOSIUM ON MIXED AND AUGMENTED REALITY 2008, PROCEEDINGS, 2008, : 21 - +
  • [4] Optimal Hand-Eye Calibration of IMU and Camera
    Yang, Guang
    Zhao, Long
    [J]. 2017 CHINESE AUTOMATION CONGRESS (CAC), 2017, : 1023 - 1028
  • [5] An experimental study on the IMU/DGPS/camera system calibration
    Li, Qiu
    Guo, Dahai
    [J]. GEOINFORMATICS 2007: REMOTELY SENSED DATA AND INFORMATION, PTS 1 AND 2, 2007, 6752
  • [6] Visual-inertial state estimation with camera and camera-IMU calibration
    Arbabmir, Mohammadvali
    Ebrahimi, Masoud
    [J]. ROBOTICS AND AUTONOMOUS SYSTEMS, 2019, 120
  • [7] A Camera-IMU System Extrinsic Parameter Calibration Method
    Liu Tao
    Du Hongwang
    [J]. PROCEEDINGS OF 2017 IEEE 2ND INFORMATION TECHNOLOGY, NETWORKING, ELECTRONIC AND AUTOMATION CONTROL CONFERENCE (ITNEC), 2017, : 1063 - 1066
  • [8] Online Temporal Calibration of Camera and IMU using Nonlinear Optimization
    Liu, Jinxu
    Gao, Wei
    Hu, Zhanyi
    [J]. 2018 24TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2018, : 1761 - 1766
  • [9] 1-D camera calibration revisited
    [J]. Wang, B. (bowing@nlpr.ia.ac.cn), 1600, Institute of Computing Technology (26):
  • [10] A kalman filter-based algorithm for IMU-Camera calibration
    Mirzaei, Faraz M.
    Rourneliotis, Stergios I.
    [J]. 2007 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS, VOLS 1-9, 2007, : 2433 - 2440