Learning Implicit Neural Representation for Satellite Object Mesh Reconstruction

被引:3
|
作者
Yang, Xi [1 ]
Cao, Mengqing [1 ]
Li, Cong [2 ]
Zhao, Hua [3 ]
Yang, Dong [2 ]
机构
[1] Xidian Univ, Sch Telecommun Engn, State Key Lab Integrated Serv Networks, Xian 710071, Peoples R China
[2] Xian Inst Space Radio Technol, Xian 710100, Peoples R China
[3] Beijing Inst Tracking & Telecommun Technol, Beijing 100094, Peoples R China
基金
中国国家自然科学基金;
关键词
3D reconstruction; point cloud; implicit surface; satellite;
D O I
10.3390/rs15174163
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Constructing a surface representation from the sparse point cloud of a satellite is an important task for satellite on-orbit services such as satellite docking and maintenance. In related studies on surface reconstruction from point clouds, implicit neural representations have gained popularity in learning-based 3D object reconstruction. When aiming for a satellite with a more complicated geometry and larger intra-class variance, existing implicit approaches cannot perform well. To solve the above contradictions and make effective use of implicit neural representations, we built a NASA3D dataset containing point clouds, watertight meshes, occupancy values, and corresponding points by using the 3D models on NASA's official website. On the basis of NASA3D, we propose a novel network called GONet for a more detailed reconstruction of satellite grids. By designing an explicit-related implicit neural representation of the Grid Occupancy Field (GOF) and introducing it into GONet, we compensate for the lack of explicit supervision in existing point cloud surface reconstruction approaches. The GOF, together with the occupancy field (OF), serves as the supervised information for neural network learning. Learning the GOF strengthens GONet's attention to the critical points of the surface extraction algorithm Marching Cubes; thus, it helps improve the reconstructed surface's accuracy. In addition, GONet uses the same encoder and decoder as ConvONet but designs a novel Adaptive Feature Aggregation (AFA) module to achieve an adaptive fusion of planar and volume features. The insertion of AFA allows for the obtained implicit features to incorporate more geometric and volumetric information. Both visualization and quantitative experimental results demonstrate that our GONet could handle 3D satellite reconstruction work and outperform existing state-of-the-art methods by a significant margin. With a watertight mesh, our GONet achieves 5.507 CD-L1, 0.8821 F-score, and 68.86% IoU, which is equal to gains of 1.377, 0.0466, and 3.59% over the previous methods using NASA3D, respectively.
引用
收藏
页数:16
相关论文
共 50 条
  • [1] Sat-Mesh: Learning Neural Implicit Surfaces for Multi-View Satellite Reconstruction
    Qu, Yingjie
    Deng, Fei
    REMOTE SENSING, 2023, 15 (17)
  • [2] Hybrid mesh-neural representation for 3D transparent object reconstruction
    Xu, Jiamin
    Zhu, Zihan
    Bao, Hujun
    Xu, Weiwei
    COMPUTATIONAL VISUAL MEDIA, 2025, 11 (01): : 123 - 140
  • [3] A progressive mesh simplification algorithm based on neural implicit representation
    Chen, Yihua
    COMPUTATIONAL INTELLIGENCE, 2024, 40 (01)
  • [4] NeRP: Implicit Neural Representation Learning With Prior Embedding for Sparsely Sampled Image Reconstruction
    Shen, Liyue
    Pauly, John
    Xing, Lei
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (01) : 770 - 782
  • [5] Implicit Neural Representation for Mesh-Free Inverse Obstacle Scattering
    Vlasic, Tin
    Hieu Nguyen
    Khorashadizadeh, AmirEhsan
    Dokmanic, Ivan
    2022 56TH ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS, AND COMPUTERS, 2022, : 947 - 952
  • [6] Neural Vector Fields: Implicit Representation by Explicit Learning
    Yang, Xianghui
    Lin, Guosheng
    Chen, Zhenghao
    Zhou, Luping
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 16727 - 16738
  • [7] Spectral-Wise Implicit Neural Representation for Hyperspectral Image Reconstruction
    Chen, Huan
    Zhao, Wangcai
    Xu, Tingfa
    Shi, Guokai
    Zhou, Shiyun
    Liu, Peifu
    Li, Jianan
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (05) : 3714 - 3727
  • [8] Continuous Spatial-Spectral Reconstruction via Implicit Neural Representation
    Xu, Ruikang
    Yao, Mingde
    Chen, Chang
    Wang, Lizhi
    Xiong, Zhiwei
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2025, 133 (01) : 106 - 128
  • [9] Efficient neural implicit representation for 3D human reconstruction
    Huang, Zexu
    Erfani, Sarah Monazam
    Lu, Siying
    Gong, Mingming
    PATTERN RECOGNITION, 2024, 156
  • [10] NeSVoR: Implicit Neural Representation for Slice-to-Volume Reconstruction in MRI
    Xu, Junshen
    Moyer, Daniel
    Gagoski, Borjan
    Iglesias, Juan Eugenio
    Grant, P. Ellen
    Golland, Polina
    Adalsteinsson, Elfar
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2023, 42 (06) : 1707 - 1719