Vision-Based Spacecraft Pose Estimation via a Deep Convolutional Neural Network for Noncooperative Docking Operations

被引:39
|
作者
Phisannupawong, Thaweerath [1 ,2 ]
Kamsing, Patcharin [1 ]
Torteeka, Peerapong [3 ]
Channumsin, Sittiporn [4 ]
Sawangwit, Utane [3 ]
Hematulin, Warunyu [1 ]
Jarawan, Tanatthep [1 ]
Somjit, Thanaporn [1 ]
Yooyen, Soemsak [1 ]
Delahaye, Daniel [5 ]
Boonsrimuang, Pisit [6 ]
机构
[1] King Mongkuts Inst Technol Ladkrabang, Int Acad Aviat Ind, Dept Aeronaut Engn, Air Space Control Optimizat & Management Lab, Bangkok 10520, Thailand
[2] Natl Astron Res Inst Thailand, Internship Program, Chiang Mai 50180, Thailand
[3] Natl Astron Res Inst Thailand, Res Grp, Chiang Mai 50180, Thailand
[4] Geoinformat & Space Technol Dev Agcy GISTDA, Astrodynam Res Lab, Chon Buri 20230, Thailand
[5] Ecole Natl Aviat Civile, F-31400 Toulouse, France
[6] King Mongkuts Inst Technol Ladkrabang, Fac Engn, Bangkok 10520, Thailand
关键词
spacecraft docking operation; on-orbit services; pose estimation; deep convolutional neural network;
D O I
10.3390/aerospace7090126
中图分类号
V [航空、航天];
学科分类号
08 ; 0825 ;
摘要
The capture of a target spacecraft by a chaser is an on-orbit docking operation that requires an accurate, reliable, and robust object recognition algorithm. Vision-based guided spacecraft relative motion during close-proximity maneuvers has been consecutively applied using dynamic modeling as a spacecraft on-orbit service system. This research constructs a vision-based pose estimation model that performs image processing via a deep convolutional neural network. The pose estimation model was constructed by repurposing a modified pretrained GoogLeNet model with the available Unreal Engine 4 rendered dataset of the Soyuz spacecraft. In the implementation, the convolutional neural network learns from the data samples to create correlations between the images and the spacecraft's six degrees-of-freedom parameters. The experiment has compared an exponential-based loss function and a weighted Euclidean-based loss function. Using the weighted Euclidean-based loss function, the implemented pose estimation model achieved moderately high performance with a position accuracy of 92.53 percent and an error of 1.2 m. The in-attitude prediction accuracy can reach 87.93 percent, and the errors in the three Euler angles do not exceed 7.6 degrees. This research can contribute to spacecraft detection and tracking problems. Although the finished vision-based model is specific to the environment of synthetic dataset, the model could be trained further to address actual docking operations in the future.
引用
收藏
页码:1 / 22
页数:22
相关论文
共 50 条
  • [31] Online Evolution of Deep Convolutional Network for Vision-Based Reinforcement Learning
    Koutnik, Jan
    Schmidhuber, Juergen
    Gomez, Faustino
    FROM ANIMALS TO ANIMATS 13, 2014, 8575 : 260 - 269
  • [32] Optimal Deep Convolutional Neural Network with Pose Estimation for Human Activity Recognition
    Nandagopal, S.
    Karthy, G.
    Oliver, A. Sheryl
    Subha, M.
    COMPUTER SYSTEMS SCIENCE AND ENGINEERING, 2023, 44 (02): : 1719 - 1733
  • [33] Vision-based Robotic Grasp Success Determination with Convolutional Neural Network
    Zhang, Hanbo
    Lan, Xuguang
    Zhou, Xinwen
    Wang, Jianji
    Zheng, Nanning
    2017 IEEE 7TH ANNUAL INTERNATIONAL CONFERENCE ON CYBER TECHNOLOGY IN AUTOMATION, CONTROL, AND INTELLIGENT SYSTEMS (CYBER), 2017, : 31 - 36
  • [34] Squirrel Search Optimization with Deep Convolutional Neural Network for Human Pose Estimation
    Ishwarya, K.
    Nithya, A. Alice
    CMC-COMPUTERS MATERIALS & CONTINUA, 2023, 74 (03): : 6081 - 6099
  • [35] Vehicle Pose Estimation in WAMI Imagery via Deep Convolutional Neural Networks
    Yi, Meng
    Wang, Dong
    Yang, Fan
    Xu, Jonathan
    Cai, Yiran
    Blasch, Erik
    Sheaff, Carolyn
    Chen, Genshe
    Ling, Haibin
    PROCEEDINGS OF THE 2016 IEEE NATIONAL AEROSPACE AND ELECTRONICS CONFERENCE (NAECON) AND OHIO INNOVATION SUMMIT (OIS), 2016, : 233 - 240
  • [36] Vision-Based Concrete Crack Detection Using a Convolutional Neural Network
    Cha, Young-Jin
    Choi, Wooram
    DYNAMICS OF CIVIL STRUCTURES, VOL 2, 2017, : 71 - 73
  • [37] Vision-based navigation for rendezvous, docking and proximity operations
    Junkins, JL
    Hughes, DC
    Wazni, KP
    Pariyapong, V
    GUIDANCE AND CONTROL 1999, 1999, 101 : 203 - 220
  • [38] Adaptive Neural-Network-Based Unscented Kalman Filter for Robust Pose Tracking of Noncooperative Spacecraft
    Park, Tae Ha
    D'Amico, Simone
    JOURNAL OF GUIDANCE CONTROL AND DYNAMICS, 2023, 46 (09) : 1671 - 1688
  • [39] Human Pose Estimation via Multi-resolution Convolutional Neural Network
    Zhu, Aichun
    Jin, Jing
    Wang, Tian
    Zhu, Qiurong
    PROCEEDINGS 2017 4TH IAPR ASIAN CONFERENCE ON PATTERN RECOGNITION (ACPR), 2017, : 700 - 705
  • [40] Multiclass classification based on a deep convolutional network for head pose estimation
    Ying Cai
    Meng-long Yang
    Jun Li
    Frontiers of Information Technology & Electronic Engineering, 2015, 16 : 930 - 939