Shape Reconstruction of Object-Level Building From Single Image Based on Implicit Representation Network

被引:2
|
作者
Zhao, Chunhui [1 ,2 ]
Zhang, Chi [1 ,2 ]
Yan, Yiming [1 ,2 ]
Su, Nan [1 ,2 ]
机构
[1] Harbin Engn Univ, Coll Informat & Commun Engn, Harbin 150001, Peoples R China
[2] Harbin Engn Univ, Key Lab Adv Marine Commun & Informat Technol, Minist Ind & Informat Technol, Harbin 150001, Peoples R China
基金
中国国家自然科学基金;
关键词
Buildings; Image reconstruction; Shape; Feature extraction; Three-dimensional displays; Training; Surface reconstruction; implicit representation network (IRNet); remote sensing images; shape reconstruction;
D O I
10.1109/LGRS.2021.3126767
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Three-dimensional shape reconstruction of the object-level building (SROLB) is one of the essential issues in remote sensing. Especially, utilizing the single remote sensing image (SRSI) to perform shape reconstruction can offer better scalability and transferability, in terms of simplifying input data. Recently, the methods of shape reconstruction based on neural networks have been widely studied. However, most of them generate models with irregular surfaces and few details. Besides, complex background in SRSI leads to a poor generalization of networks and reduces the quality of generated models. To solve the above problems, an implicit representation network (IRNet) is proposed in this letter. IRNet is composed of two parts: 3-D space decoding and feature extraction. First, the signed distance function (SDF) is employed to fit implicit representation better in the decoding module. Moreover, a multistage weight loss function is designed, making the network generating models with flatter surfaces and more details. Then, a channel attention (CA) module is added to the feature extraction network. It reduces the interference of the background in the image effectively and improves the generalization of the network. Finally, our method generates mesh models of the individual buildings. The experimental results show that a better accuracy can be obtained compared with state-of-the-art methods.
引用
收藏
页数:5
相关论文
共 50 条
  • [1] Object Bank: An Object-Level Image Representation for High-Level Visual Recognition
    Li-Jia Li
    Hao Su
    Yongwhan Lim
    Li Fei-Fei
    International Journal of Computer Vision, 2014, 107 : 20 - 39
  • [2] Object Bank: An Object-Level Image Representation for High-Level Visual Recognition
    Li, Li-Jia
    Su, Hao
    Lim, Yongwhan
    Li Fei-Fei
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2014, 107 (01) : 20 - 39
  • [3] Unsupervised Object-Level Representation Learning from Scene Images
    Xie, Jiahao
    Zhan, Xiaohang
    Liu, Ziwei
    Ong, Yew Soon
    Loy, Chen Change
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021,
  • [4] Image classification using DETR based object-level feature
    Ban, Chung-Gi
    Park, Dayoung
    Hwang, Youngbae
    2022 22ND INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND SYSTEMS (ICCAS 2022), 2022, : 1297 - 1300
  • [5] Approximating content-based object-level image retrieval
    Hsu, W
    Chua, TS
    Pung, HK
    MULTIMEDIA TOOLS AND APPLICATIONS, 2000, 12 (01) : 59 - 79
  • [6] Approximating Content-Based Object-Level Image Retrieval
    Wynne Hsu
    T.S. Chua
    H.K. Pung
    Multimedia Tools and Applications, 2000, 12 : 59 - 79
  • [7] Localizing Object-level Shape Variations with Text-to-Image Diffusion Models
    Patashnik, Or
    Garibi, Daniel
    Azuri, Idan
    Averbuch-Elor, Hadar
    Cohen-Or, Daniel
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 22994 - 23004
  • [8] Detection Based Part-level Articulated Object Reconstruction from Single RGBD Image
    Kawana, Yuki
    Harada, Tatsuya
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [9] OBJECT RECONSTRUCTION IN AN IMAGE BASED ON BELIEF FUNCTION REPRESENTATION
    Rekik, W.
    Le Hegarat-Mascle, S.
    Andre, C.
    Kallel, A.
    Reynaud, R.
    Ben Hamida, A.
    2014 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2014, : 1633 - 1637
  • [10] An Unsupervised Object-Level Image Segmentation Method Based on Foreground and Background Priors
    Wang, Chunlai
    Yang, Bin
    2016 IEEE SOUTHWEST SYMPOSIUM ON IMAGE ANALYSIS AND INTERPRETATION (SSIAI), 2016, : 141 - 144