A deep learning based fusion of RGB camera information and magnetic localization information for endoscopic capsule robots

被引：22
|
作者：
Turan M. [1 ]
Shabbir J. [2 ]
Araujo H. [2 ]
Konukoglu E. [3 ]
Sitti M. [1 ]
机构：
[1] Physical Intelligence Department, Max Planck Institute for Intelligent Systems, Stuttgart
[2] Institute for Systems and Robotics, Universidade de Coimbra, Coimbra
[3] Computer Vision Laboratory, ETH Zurich, Zurich
来源：
International Journal of Intelligent Robotics and Applications | 2017年 / 1卷 / 4期
关键词：
Deep Learning based Sensor Fusion; Endoscopic Capsule Robots; RNN-CNN (RNN:Recurrent Neural Network; CNN: Convolutional Neural Network);
D O I：
10.1007/s41315-017-0039-1
中图分类号：
学科分类号：
摘要：
A reliable, real time localization functionality is crutial for actively controlled capsule endoscopy robots, which are an emerging, minimally invasive diagnostic and therapeutic technology for the gastrointestinal (GI) tract. In this study, we extend the success of deep learning approaches from various research fields to the problem of sensor fusion for endoscopic capsule robots. We propose a multi-sensor fusion based localization approach which combines endoscopic camera information and magnetic sensor based localization information. The results performed on real pig stomach dataset show that our method achieves sub-millimeter precision for both translational and rotational movements. © 2017, The Author(s).
引用
收藏
页码：442 / 450
页数：8
相关论文
共 50 条
  • [21] AI-Based Sensor Information Fusion for Supporting Deep Supervised Learning
    Leung, Carson K.
    Braun, Peter
    Cuzzocrea, Alfredo
    SENSORS, 2019, 19 (06)
  • [22] Artificial Intelligence Algorithms for Multisensor Information Fusion Based on Deep Learning Algorithms
    Jiang, Lan
    MOBILE INFORMATION SYSTEMS, 2022, 2022
  • [23] Remote control for mobile robots using gestures captured by the RGB camera and recognized by deep learning techniques
    Martinelli, Dieisson
    de Sousa, Alex Luiz
    Augusto, Mario Ezequiel
    Kalempa, Vivian Cremer
    de Oliveira, Andre Schneider
    Rohrich, Ronnier Frates
    Simoes Teixeira, Marco Antonio
    2019 LATIN AMERICAN ROBOTICS SYMPOSIUM, 2019 BRAZILIAN SYMPOSIUM ON ROBOTICS (SBR) AND 2019 WORKSHOP ON ROBOTICS IN EDUCATION (LARS-SBR-WRE 2019), 2019, : 98 - 103
  • [24] Moving Object Detection Based on Fusion of Depth Information and RGB Features
    Bi, Xin
    Yang, Shichao
    Tong, Panpan
    SENSORS, 2022, 22 (13)
  • [25] Unsupervised deep depth completion with heterogeneous LiDAR and RGB-D camera depth information
    Gou, Guohua
    Li, Han
    Wang, Xuanhao
    Zhang, Hao
    Yang, Wei
    Sui, Haigang
    INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2025, 136
  • [26] Self-localization of mobile robots based on visual information
    Lai, Li-Chun
    Lee, Tsong-Li
    Wu, Hsien-Huang P.
    Wu, Chia-Ju
    ICIEA 2006: 1ST IEEE CONFERENCE ON INDUSTRIAL ELECTRONICS AND APPLICATIONS, VOLS 1-3, PROCEEDINGS, 2006, : 1139 - 1144
  • [27] Self-localization of mobile robots based on visual information
    Lai, Li-Chun
    Lee, Tsong-Li
    Wu, Hsien-Huang P.
    Wu, Chia-Ju
    2006 1ST IEEE CONFERENCE ON INDUSTRIAL ELECTRONICS AND APPLICATIONS, VOLS 1-3, 2006, : 885 - 890
  • [28] Smartphone-Based Indoor Localization Using Machine Learning and Multisource Information Fusion
    Yan, Jun
    Huang, Zheng
    Wu, Xiaohuan
    IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS, 2024, 60 (03) : 2722 - 2734
  • [29] Noise source localization based on audiovisual information fusion
    Zhao Y.
    Li Y.
    Guo S.
    Li T.
    Li, Tiejun (li_tiejun@hebut.edu.cn), 2018, Science Press (39): : 89 - 99
  • [30] Robust Localization of Signal Source Based on Information Fusion
    Wan, Pengwu
    Yan, Qianli
    Lu, Guangyue
    Wang, Jin
    Huang, Qiongdan
    IEEE SYSTEMS JOURNAL, 2021, 15 (02): : 1764 - 1775
12345