Vision-Based Spacecraft Pose Estimation via a Deep Convolutional Neural Network for Noncooperative Docking Operations

被引:39
|
作者
Phisannupawong, Thaweerath [1 ,2 ]
Kamsing, Patcharin [1 ]
Torteeka, Peerapong [3 ]
Channumsin, Sittiporn [4 ]
Sawangwit, Utane [3 ]
Hematulin, Warunyu [1 ]
Jarawan, Tanatthep [1 ]
Somjit, Thanaporn [1 ]
Yooyen, Soemsak [1 ]
Delahaye, Daniel [5 ]
Boonsrimuang, Pisit [6 ]
机构
[1] King Mongkuts Inst Technol Ladkrabang, Int Acad Aviat Ind, Dept Aeronaut Engn, Air Space Control Optimizat & Management Lab, Bangkok 10520, Thailand
[2] Natl Astron Res Inst Thailand, Internship Program, Chiang Mai 50180, Thailand
[3] Natl Astron Res Inst Thailand, Res Grp, Chiang Mai 50180, Thailand
[4] Geoinformat & Space Technol Dev Agcy GISTDA, Astrodynam Res Lab, Chon Buri 20230, Thailand
[5] Ecole Natl Aviat Civile, F-31400 Toulouse, France
[6] King Mongkuts Inst Technol Ladkrabang, Fac Engn, Bangkok 10520, Thailand
关键词
spacecraft docking operation; on-orbit services; pose estimation; deep convolutional neural network;
D O I
10.3390/aerospace7090126
中图分类号
V [航空、航天];
学科分类号
08 ; 0825 ;
摘要
The capture of a target spacecraft by a chaser is an on-orbit docking operation that requires an accurate, reliable, and robust object recognition algorithm. Vision-based guided spacecraft relative motion during close-proximity maneuvers has been consecutively applied using dynamic modeling as a spacecraft on-orbit service system. This research constructs a vision-based pose estimation model that performs image processing via a deep convolutional neural network. The pose estimation model was constructed by repurposing a modified pretrained GoogLeNet model with the available Unreal Engine 4 rendered dataset of the Soyuz spacecraft. In the implementation, the convolutional neural network learns from the data samples to create correlations between the images and the spacecraft's six degrees-of-freedom parameters. The experiment has compared an exponential-based loss function and a weighted Euclidean-based loss function. Using the weighted Euclidean-based loss function, the implemented pose estimation model achieved moderately high performance with a position accuracy of 92.53 percent and an error of 1.2 m. The in-attitude prediction accuracy can reach 87.93 percent, and the errors in the three Euler angles do not exceed 7.6 degrees. This research can contribute to spacecraft detection and tracking problems. Although the finished vision-based model is specific to the environment of synthetic dataset, the model could be trained further to address actual docking operations in the future.
引用
收藏
页码:1 / 22
页数:22
相关论文
共 50 条
  • [21] Non-Model-Based Monocular Pose Estimation Network for Uncooperative Spacecraft Using Convolutional Neural Network
    Huang, Haoran
    Zhao, Gaopeng
    Gu, Dongqing
    Bo, Yuming
    IEEE SENSORS JOURNAL, 2021, 21 (21) : 24579 - 24590
  • [22] Deep convolutional neural network-based Bernoulli heatmap for head pose estimation
    Hu, Zhongxu
    Xing, Yang
    Lv, Chen
    Hang, Peng
    Liu, Jie
    NEUROCOMPUTING, 2021, 436 : 198 - 209
  • [23] Vision-Based In Situ Monitoring of Plankton Size Spectra Via a Convolutional Neural Network
    Wang, Nan
    Yu, Jia
    Yang, Biao
    Zheng, Haiyong
    Zheng, Bing
    IEEE JOURNAL OF OCEANIC ENGINEERING, 2020, 45 (02) : 511 - 520
  • [24] Vision-Based AUV Docking to an Underway Dock using Convolutional Neural Networks
    Singh, Parmeet
    Gregson, Edward
    Ross, Jordan
    Seto, Mae
    Kaminski, Chris
    Hopkin, David
    2020 IEEE/OES AUTONOMOUS UNDERWATER VEHICLES SYMPOSIUM (AUV), 2020,
  • [25] Head Pose Estimation Based on Robust Convolutional Neural Network
    Bao, Jiao
    Ye, Mao
    CYBERNETICS AND INFORMATION TECHNOLOGIES, 2016, 16 (06) : 133 - 145
  • [26] GYRO-AIDED VISION-BASED RELATIVE POSE ESTIMATION FOR AUTONOMOUS RENDEZVOUS AND DOCKING
    Ghadiok, Vaibhav
    Goldin, Jeremy
    Geller, David
    GUIDANCE AND CONTROL 2013, 2013, 149 : 713 - 728
  • [27] NeuroGrasp: Multimodal Neural Network With Euler Region Regression for Neuromorphic Vision-Based Grasp Pose Estimation
    Cao, Hu
    Chen, Guang
    Li, Zhijun
    Hu, Yingbai
    Knoll, Alois
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71
  • [28] Human Pose Estimation Based on Deep Neural Network
    Zhu, Lingfei
    Wan, Wanggen
    2018 INTERNATIONAL CONFERENCE ON AUDIO, LANGUAGE AND IMAGE PROCESSING (ICALIP), 2018, : 90 - 96
  • [29] Vision-based hand pose estimation: A review
    Erol, Ali
    Bebis, George
    Nicolescu, Mircea
    Boyle, Richard D.
    Twombly, Xander
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2007, 108 (1-2) : 52 - 73
  • [30] Vision-based Neural Scene Representations for Spacecraft
    Mergy, Anne
    Lecuyer, Gurvan
    Derksen, Dawa
    Izzo, Dario
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2021, 2021, : 2002 - 2011