Shape Reconstruction of Object-Level Building From Single Image Based on Implicit Representation Network

被引:2
|
作者
Zhao, Chunhui [1 ,2 ]
Zhang, Chi [1 ,2 ]
Yan, Yiming [1 ,2 ]
Su, Nan [1 ,2 ]
机构
[1] Harbin Engn Univ, Coll Informat & Commun Engn, Harbin 150001, Peoples R China
[2] Harbin Engn Univ, Key Lab Adv Marine Commun & Informat Technol, Minist Ind & Informat Technol, Harbin 150001, Peoples R China
基金
中国国家自然科学基金;
关键词
Buildings; Image reconstruction; Shape; Feature extraction; Three-dimensional displays; Training; Surface reconstruction; implicit representation network (IRNet); remote sensing images; shape reconstruction;
D O I
10.1109/LGRS.2021.3126767
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Three-dimensional shape reconstruction of the object-level building (SROLB) is one of the essential issues in remote sensing. Especially, utilizing the single remote sensing image (SRSI) to perform shape reconstruction can offer better scalability and transferability, in terms of simplifying input data. Recently, the methods of shape reconstruction based on neural networks have been widely studied. However, most of them generate models with irregular surfaces and few details. Besides, complex background in SRSI leads to a poor generalization of networks and reduces the quality of generated models. To solve the above problems, an implicit representation network (IRNet) is proposed in this letter. IRNet is composed of two parts: 3-D space decoding and feature extraction. First, the signed distance function (SDF) is employed to fit implicit representation better in the decoding module. Moreover, a multistage weight loss function is designed, making the network generating models with flatter surfaces and more details. Then, a channel attention (CA) module is added to the feature extraction network. It reduces the interference of the background in the image effectively and improves the generalization of the network. Finally, our method generates mesh models of the individual buildings. The experimental results show that a better accuracy can be obtained compared with state-of-the-art methods.
引用
收藏
页数:5
相关论文
共 50 条
  • [21] Object-Level Contrastive-Learning-Based Multi-Branch Network for Building Change Detection from Bi-Temporal Remote Sensing Images
    Li, Shiming
    Yan, Fengtao
    Liao, Cheng
    Hu, Qingfeng
    Ma, Kaifeng
    Wang, Wei
    Zhang, Hui
    REMOTE SENSING, 2025, 17 (02)
  • [22] 3D Reconstruction From A Single Image Based On Shape Evolution
    Ma, Qian
    PROCEEDINGS OF THE 2015 3RD INTERNATIONAL CONFERENCE ON MACHINERY, MATERIALS AND INFORMATION TECHNOLOGY APPLICATIONS, 2015, 35 : 834 - 839
  • [23] Object Reconstruction Based on Attentive Recurrent Network from Single and Multiple Images
    Zishu Gao
    En Li
    Zhe Wang
    Guodong Yang
    Jiwu Lu
    Bo Ouyang
    Dawei Xu
    Zize Liang
    Neural Processing Letters, 2021, 53 : 653 - 670
  • [24] Object Reconstruction Based on Attentive Recurrent Network from Single and Multiple Images
    Gao, Zishu
    Li, En
    Wang, Zhe
    Yang, Guodong
    Lu, Jiwu
    Ouyang, Bo
    Xu, Dawei
    Liang, Zize
    NEURAL PROCESSING LETTERS, 2021, 53 (01) : 653 - 670
  • [25] A Point Set Generation Network for 3D Object Reconstruction from a Single Image
    Fan, Haoqiang
    Su, Hao
    Guibas, Leonidas
    30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 2463 - 2471
  • [26] Shape, Albedo, and Illumination from a Single Image of an Unknown Object
    Barron, Jonathan T.
    Malik, Jitendra
    2012 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2012, : 334 - 341
  • [27] Multi-level image segmentation and object representation for content based image retrieval
    Duygulu, P
    Yarman-Vural, F
    STORAGE AND RETRIEVAL FOR MEDIA DATABASES 2001, 2001, 4315 : 460 - 469
  • [28] Attention-based 3D Object Reconstruction from a Single Image
    Salvi, Andrey
    Gavenski, Nathan
    Pooch, Eduardo
    Tasoniero, Felipe
    Barros, Rodrigo
    2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,
  • [29] Category-Specific Object Reconstruction from a Single Image
    Kar, Abhishek
    Tulsiani, Shubham
    Carreira, Joao
    Malik, Jitendra
    2015 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2015, : 1966 - 1974
  • [30] RealFusion 360° Reconstruction of Any Object from a Single Image
    Melas-Kyriazi, Luke
    Laina, Iro
    Rupprecht, Christian
    Vedaldi, Andrea
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 8446 - 8455