Structure-aware indoor scene reconstruction via two levels of abstraction

被引:13
|
作者
Fang, Hao [1 ]
Pan, Cihui [2 ]
Huang, Hui [1 ]
机构
[1] Shenzhen Univ, Shenzhen, Peoples R China
[2] BeiKe, Beijing, Peoples R China
关键词
Indoor scene reconstruction; Point cloud; Mesh processing; Primitive detection; Space partitioning; Markov random field; Surface reconstruction; ENERGY MINIMIZATION; POINT;
D O I
10.1016/j.isprsjprs.2021.06.007
中图分类号
P9 [自然地理学];
学科分类号
0705 ; 070501 ;
摘要
In this paper, we propose a novel approach that reconstructs the indoor scene in a structure-aware manner and produces two meshes with different levels of abstraction. To be precise, we start from the raw triangular mesh of indoor scene and decompose it into two parts: structure and non-structure objects. On the one hand, structure objects are defined as significant permanent parts in the indoor environment such as floors, ceilings and walls. In the proposed algorithm, structure objects are abstracted by planar primitives and assembled into a polygonal structure mesh. This step produces a compact structure-aware watertight model that decreases the complexity of original mesh by three orders of magnitude. On the other hand, non-structure objects are movable objects in the indoor environment such as furniture and interior decoration. Meshes of these objects are repaired and simplified according to their relationship with respect to structure primitives. Finally, the union of all the non-structure meshes and structure mesh comprises the scene mesh. Note that structure mesh and scene mesh preserve various levels of abstraction and can be used for different applications according to user preference. Our experiments on both LIDAR and RGBD data scanned from simple to large scale indoor scenes indicate that the proposed framework generates structure-aware results while being robust and scalable. It is also compared qualitatively and quantitatively against popular mesh approximation, floorplan generation and piecewise-planar surface reconstruction methods to demonstrate its performance.
引用
收藏
页码:155 / 170
页数:16
相关论文
共 50 条
  • [1] Structure-aware QR Code abstraction
    Qiao, Siyuan
    Fang, Xiaoxin
    Sheng, Bin
    Wu, Wen
    Wu, Enhua
    [J]. VISUAL COMPUTER, 2015, 31 (6-8): : 1123 - 1133
  • [2] Structure-aware QR Code abstraction
    Siyuan Qiao
    Xiaoxin Fang
    Bin Sheng
    Wen Wu
    Enhua Wu
    [J]. The Visual Computer, 2015, 31 : 1123 - 1133
  • [3] Structure-Aware Surface Reconstruction via Primitive Assembly
    Jiang, Jingen
    Zhao, Mingyang
    Xin, Shiqing
    Yang, Yanchao
    Wang, Hanxiao
    Jia, Xiaohong
    Yan, Dong-Ming
    [J]. 2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 14125 - 14134
  • [4] Structure-aware simplified algorithm of mesh model for urban scene
    Zhang, Chunsen
    Zhang, Hui
    Guo, Binxuan
    Peng, Zhe
    [J]. Cehui Xuebao/Acta Geodaetica et Cartographica Sinica, 2020, 49 (03): : 334 - 342
  • [5] Response Generation via Structure-Aware Constraints
    Guan, Mengyu
    Wang, Zhongqing
    Zhou, Guodong
    [J]. ACM TRANSACTIONS ON ASIAN AND LOW-RESOURCE LANGUAGE INFORMATION PROCESSING, 2022, 21 (06)
  • [6] Structure-aware fusion network for 3D scene understanding
    Yan, Haibin
    Lv, Yating
    Liong, Venice Erin
    [J]. CHINESE JOURNAL OF AERONAUTICS, 2022, 35 (05) : 194 - 203
  • [7] GATE FUNCTION BASED STRUCTURE-AWARE CONVOLUTION FOR SCENE SEMANTIC SEGMENTATION
    Cheng, Zhou
    Li, Jiancheng
    Yuan, Chun
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2017, : 253 - 258
  • [8] Structure-aware fusion network for 3D scene understanding
    Haibin YAN
    Yating LV
    Venice Erin LIONG
    [J]. Chinese Journal of Aeronautics., 2022, 35 (05) - 203
  • [9] Attentional Graph Convolutional Network for Structure-Aware Audiovisual Scene Classification
    Zhou, Liguang
    Zhou, Yuhongze
    Qi, Xiaonan
    Hu, Junjie
    Lam, Tin Lun
    Xu, Yangsheng
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
  • [10] Structure-aware fusion network for 3D scene understanding
    YAN, Haibin
    LV, Yating
    LIONG, Venice Erin
    [J]. Chinese Journal of Aeronautics, 2022, 35 (05): : 194 - 203