Learning Implicit Neural Representation for Satellite Object Mesh Reconstruction

被引:3
|
作者
Yang, Xi [1 ]
Cao, Mengqing [1 ]
Li, Cong [2 ]
Zhao, Hua [3 ]
Yang, Dong [2 ]
机构
[1] Xidian Univ, Sch Telecommun Engn, State Key Lab Integrated Serv Networks, Xian 710071, Peoples R China
[2] Xian Inst Space Radio Technol, Xian 710100, Peoples R China
[3] Beijing Inst Tracking & Telecommun Technol, Beijing 100094, Peoples R China
基金
中国国家自然科学基金;
关键词
3D reconstruction; point cloud; implicit surface; satellite;
D O I
10.3390/rs15174163
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Constructing a surface representation from the sparse point cloud of a satellite is an important task for satellite on-orbit services such as satellite docking and maintenance. In related studies on surface reconstruction from point clouds, implicit neural representations have gained popularity in learning-based 3D object reconstruction. When aiming for a satellite with a more complicated geometry and larger intra-class variance, existing implicit approaches cannot perform well. To solve the above contradictions and make effective use of implicit neural representations, we built a NASA3D dataset containing point clouds, watertight meshes, occupancy values, and corresponding points by using the 3D models on NASA's official website. On the basis of NASA3D, we propose a novel network called GONet for a more detailed reconstruction of satellite grids. By designing an explicit-related implicit neural representation of the Grid Occupancy Field (GOF) and introducing it into GONet, we compensate for the lack of explicit supervision in existing point cloud surface reconstruction approaches. The GOF, together with the occupancy field (OF), serves as the supervised information for neural network learning. Learning the GOF strengthens GONet's attention to the critical points of the surface extraction algorithm Marching Cubes; thus, it helps improve the reconstructed surface's accuracy. In addition, GONet uses the same encoder and decoder as ConvONet but designs a novel Adaptive Feature Aggregation (AFA) module to achieve an adaptive fusion of planar and volume features. The insertion of AFA allows for the obtained implicit features to incorporate more geometric and volumetric information. Both visualization and quantitative experimental results demonstrate that our GONet could handle 3D satellite reconstruction work and outperform existing state-of-the-art methods by a significant margin. With a watertight mesh, our GONet achieves 5.507 CD-L1, 0.8821 F-score, and 68.86% IoU, which is equal to gains of 1.377, 0.0466, and 3.59% over the previous methods using NASA3D, respectively.
引用
收藏
页数:16
相关论文
共 50 条
  • [31] Continual Neural Mapping: Learning An Implicit Scene Representation from Sequential Observations
    Yan, Zike
    Tian, Yuxin
    Shi, Xuesong
    Guo, Ping
    Wang, Peng
    Zha, Hongbin
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 15762 - 15772
  • [32] Implicit geometry neural network for mesh generation
    Xu, Ran
    Lyu, Hongqiang
    Yu, Jian
    Bao, Chenyu
    Wang, Hongfei
    Liu, Yufei
    Liu, Xuejun
    CHINESE JOURNAL OF AERONAUTICS, 2025, 38 (04)
  • [33] Neural Knitworks: Patched neural implicit representation networks
    Czerkawski, Mikolaj
    Cardona, Javier
    Atkinson, Robert
    Michie, Craig
    Andonovic, Ivan
    Clemente, Carmine
    Tachtatzis, Christos
    PATTERN RECOGNITION, 2024, 151
  • [34] Shape Reconstruction of Object-Level Building From Single Image Based on Implicit Representation Network
    Zhao, Chunhui
    Zhang, Chi
    Yan, Yiming
    Su, Nan
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [35] PINER: Prior-informed Implicit Neural Representation Learning for Test-time Adaptation in Sparse-view CT Reconstruction
    Song, Bowen
    Shen, Liyue
    Xing, Lei
    2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, : 1928 - 1937
  • [36] REPRESENTATION RECONSTRUCTION HEAD FOR OBJECT DETECTION
    Miao, Shuyu
    Feng, Rui
    Zhang, Yuejie
    2020 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2020, : 1516 - 1520
  • [37] A SCAN-SPECIFIC UNSUPERVISED METHOD FOR PARALLEL MRI RECONSTRUCTION CIA IMPLICIT NEURAL REPRESENTATION
    Feng, Ruimin
    Wu, Qing
    Zhang, Yuyao
    Wei, Hongjiang
    2023 IEEE 20TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING, ISBI, 2023,
  • [38] Generic deformable implicit mesh models for automated reconstruction
    Ilic, S
    Fua, P
    FIRST IEEE INTERNATIONAL WORKSHOP ON HIGHER-LEVEL KNOWLEDGE IN 3D MODELING AND MOTION ANALYSIS, PROCEEDINGS, 2003, : 29 - 38
  • [39] IREM: High-Resolution Magnetic Resonance Image Reconstruction via Implicit Neural Representation
    Wu, Qing
    Li, Yuwei
    Xu, Lan
    Feng, Ruiming
    Wei, Hongjiang
    Yang, Qing
    Yu, Boliang
    Liu, Xiaozhao
    Yu, Jingyi
    Zhang, Yuyao
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2021, PT VI, 2021, 12906 : 65 - 74
  • [40] Implicit updating of object representation via temporal associations
    Yu, Ru Qi
    Zhao, Jiaying
    COGNITION, 2018, 181 : 127 - 134