A deep learning based fusion of RGB camera information and magnetic localization information for endoscopic capsule robots

被引：22
|
作者：
Turan M. [1 ]
Shabbir J. [2 ]
Araujo H. [2 ]
Konukoglu E. [3 ]
Sitti M. [1 ]
机构：
[1] Physical Intelligence Department, Max Planck Institute for Intelligent Systems, Stuttgart
[2] Institute for Systems and Robotics, Universidade de Coimbra, Coimbra
[3] Computer Vision Laboratory, ETH Zurich, Zurich
来源：
International Journal of Intelligent Robotics and Applications | 2017年 / 1卷 / 4期
关键词：
Deep Learning based Sensor Fusion; Endoscopic Capsule Robots; RNN-CNN (RNN:Recurrent Neural Network; CNN: Convolutional Neural Network);
D O I：
10.1007/s41315-017-0039-1
中图分类号：
学科分类号：
摘要：
A reliable, real time localization functionality is crutial for actively controlled capsule endoscopy robots, which are an emerging, minimally invasive diagnostic and therapeutic technology for the gastrointestinal (GI) tract. In this study, we extend the success of deep learning approaches from various research fields to the problem of sensor fusion for endoscopic capsule robots. We propose a multi-sensor fusion based localization approach which combines endoscopic camera information and magnetic sensor based localization information. The results performed on real pig stomach dataset show that our method achieves sub-millimeter precision for both translational and rotational movements. © 2017, The Author(s).
引用
收藏
页码：442 / 450
页数：8
相关论文
共 50 条
  • [31] Localization system for pedestrians based on sensor and information fusion
    Anacleto, Ricardo
    Figueiredo, Lino
    Almeida, Ana
    Novais, Paulo
    2014 17TH INTERNATIONAL CONFERENCE ON INFORMATION FUSION (FUSION), 2014,
  • [32] Autonomous Exploration of Mobile Robots via Deep Reinforcement Learning Based on Spatiotemporal Information on Graph
    Zhang, Zhiwen
    Shi, Chenghao
    Zhu, Pengming
    Zeng, Zhiwen
    Zhang, Hui
    APPLIED SCIENCES-BASEL, 2021, 11 (18):
  • [33] Self-localization for indoor mobile robots based on optical mouse sensor values and simple global camera information
    Sekimori, Daisuke
    Miyazaki, Fumio
    2005 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND BIOMIMETICS, 2006, : 605 - +
  • [34] Deep Learning for Confidence Information in Stereo and ToF Data Fusion
    Agresti, Gianluca
    Minto, Ludovico
    Marin, Giulio
    Zanuttigh, Pietro
    2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2017), 2017, : 697 - 705
  • [35] Multiscale information fusion-based deep learning framework for campus vehicle detection
    Xu, Zengyong
    Rao, Meili
    INTERNATIONAL JOURNAL OF IMAGE AND DATA FUSION, 2021, 12 (01) : 83 - 97
  • [36] Research on Mechanical Equipment Fault Diagnosis Method Based on Deep Learning and Information Fusion
    Jiang, Dongnian
    Wang, Zhixuan
    SENSORS, 2023, 23 (15)
  • [37] Deep learning based origin-destination prediction via contextual information fusion
    Miao, Hao
    Fei, Yan
    Wang, Senzhang
    Wang, Fang
    Wen, Danyan
    MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (09) : 12029 - 12045
  • [38] Substation equipment temperature prediction based on multivariate information fusion and deep learning network
    Sun, Lijie
    Liu, Chunxue
    Wang, Ying
    Bing, Zhaohong
    PEERJ COMPUTER SCIENCE, 2022, 8
  • [39] Multi-sensor information fusion in Internet of Vehicles based on deep learning: A review
    Tian, Di
    Li, Jiabo
    Lei, Jingyuan
    NEUROCOMPUTING, 2025, 614
  • [40] Substation equipment temperature prediction based on multivariate information fusion and deep learning network
    Sun L.
    Liu C.
    Wang Y.
    Bing Z.
    PeerJ Computer Science, 2022, 8
12345