Robust AUV Visual Loop-Closure Detection Based on Variational Autoencoder Network

被引:18
|
作者
Wang, Yangyang [1 ]
Ma, Xiaorui [1 ]
Wang, Jie [2 ]
Hou, Shilong [1 ]
Dai, Ju [3 ]
Gu, Dongbing [4 ]
Wang, Hongyu [1 ]
机构
[1] Dalian Univ Technol, Sch Informat & Commun Engn, Dalian 116024, Peoples R China
[2] Dalian Maritime Univ, Sch Informat Sci & Technol, Dalian 116026, Peoples R China
[3] Peng Cheng Lab, Shenzhen 518066, Peoples R China
[4] Univ Essex, Sch Comp Sci & Elect Engn, Colchester CO4 3SQ, Essex, England
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
Location awareness; Visualization; Semantics; Simultaneous localization and mapping; Informatics; Task analysis; Sonar navigation; Autonomous underwater vehicle (AUV) simultaneous localization and mapping (SLAM); deep neural network; loop closure detection; semantic segmentation; UNDERWATER; LOCALIZATION; ARCHITECTURE;
D O I
10.1109/TII.2022.3145860
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The visual loop-closure detection for autonomous underwater vehicles (AUVs) is a key component to reduce the drift error accumulated in simultaneous localization and mapping tasks. However, due to viewpoint changes, textureless images, and fast-moving objects, the loop closure detection in dramatically changing underwater environments remains a challenging problem to traditional geometric methods. Inspired by strong feature learning ability of deep neural networks, we propose an underwater loop-closure detection method based on a variational autoencoder network in this article. Our proposed method can learn effective image representations to deal with the challenges caused by dynamic underwater environments. Specifically, the proposed network is an unsupervised method, which avoids the difficulty and cost of labeling a great quantity of underwater data. Also included is a semantic object segmentation module, which is utilized to segment the underwater environments and assign weights to objects in order to alleviate the impact of fast-moving objects. Furthermore, an underwater image description scheme is used to enable efficient access to geometric and object-level semantic information, which helps to build a robust and real-time system in dramatically changing underwater scenarios. Finally, we test the proposed system under complex underwater environments and get a recall rate of 92.31% in the tested environments.
引用
收藏
页码:8829 / 8838
页数:10
相关论文
共 50 条
  • [1] Loop closure detection of visual SLAM based on variational autoencoder
    Song, Shibin
    Yu, Fengjie
    Jiang, Xiaojie
    Zhu, Jie
    Cheng, Weihao
    Fang, Xiao
    [J]. FRONTIERS IN NEUROROBOTICS, 2024, 17
  • [2] Global image signature for visual loop-closure detection
    Negre Carrasco, Pep Lluis
    Bonin-Font, Francisco
    Oliver-Codina, Gabriel
    [J]. AUTONOMOUS ROBOTS, 2016, 40 (08) : 1403 - 1417
  • [3] Sequence-based mapping for probabilistic visual loop-closure detection
    Tsintotas, Konstantinos A.
    Bampis, Loukas
    An, Shan
    Fragulis, George F.
    Mouroutsos, Spyridon G.
    Gasteratos, Antonios
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON IMAGING SYSTEMS AND TECHNIQUES (IST), 2021,
  • [4] Bag-of-words based Loop-closure Detection in Visual SLAM
    Zhang, Jiachen
    Ai, Dahang
    Xiang, Yi
    Chang, Xin
    Wang, Yi
    Chen, Xiaodong
    [J]. ADVANCED OPTICAL IMAGING TECHNOLOGIES, 2018, 10816
  • [5] Global image signature for visual loop-closure detection
    Pep Lluis Negre Carrasco
    Francisco Bonin-Font
    Gabriel Oliver-Codina
    [J]. Autonomous Robots, 2016, 40 : 1403 - 1417
  • [6] Real-time visual loop-closure detection
    Angeli, Adrien
    Filliat, David
    Doncieux, Stephane
    Meyer, Jean-Arcady
    [J]. 2008 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, VOLS 1-9, 2008, : 1842 - +
  • [7] A robust loop-closure method for visual SLAM in unstructured seafloor environments
    Seonghun Hong
    Jinwhan Kim
    Juhyun Pyo
    Son-Cheol Yu
    [J]. Autonomous Robots, 2016, 40 : 1095 - 1109
  • [8] Visual Loop-Closure Detection via Prominent Feature Tracking
    Papapetros, Ioannis Tsampikos
    Balaska, Vasiliki
    Gasteratos, Antonios
    [J]. JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS, 2022, 104 (03)
  • [9] A robust loop-closure method for visual SLAM in unstructured seafloor environments
    Hong, Seonghun
    Kim, Jinwhan
    Pyo, Juhyun
    Yu, Son-Cheol
    [J]. AUTONOMOUS ROBOTS, 2016, 40 (06) : 1095 - 1109
  • [10] Visual Loop-Closure Detection via Prominent Feature Tracking
    Ioannis Tsampikos Papapetros
    Vasiliki Balaska
    Antonios Gasteratos
    [J]. Journal of Intelligent & Robotic Systems, 2022, 104