Automatic 3D Indoor Scene Updating with RGBD Cameras

被引:5
|
作者
Liu, Zhenbao [1 ]
Tang, Sicong [1 ]
Xu, Weiwei [2 ]
Bu, Shuhui [1 ]
Han, Junwei [1 ]
Zhou, Kun [3 ]
机构
[1] Northwestern Polytech Univ, Xian, Peoples R China
[2] Hangzhou Normal Univ, Hangzhou, Zhejiang, Peoples R China
[3] Zhejiang Univ, Hangzhou, Zhejiang, Peoples R China
关键词
Categories and Subject Descriptors (according to ACM CCS); I; 3; 5 [Computer Graphics]: Computational Geometry and Object Modeling;
D O I
10.1111/cgf.12495
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Since indoor scenes are frequently changed in daily life, such as re-layout of furniture, the 3D reconstructions for them should be flexible and easy to update. We present an automatic 3D scene update algorithm to indoor scenes by capturing scene variation with RGBD cameras. We assume an initial scene has been reconstructed in advance in manual or other semi-automatic way before the change, and automatically update the reconstruction according to the newly captured RGBD images of the real scene update. It starts with an automatic segmentation process without manual interaction, which benefits from accurate labeling training from the initial 3D scene. After the segmentation, objects captured by RGBD camera are extracted to form a local updated scene. We formulate an optimization problem to compare to the initial scene to locate moved objects. The moved objects are then integrated with static objects in the initial scene to generate a new 3D scene. We demonstrate the efficiency and robustness of our approach by updating the 3D scene of several real-world scenes.
引用
收藏
页码:269 / 278
页数:10
相关论文
共 50 条
  • [21] Using ToF and RGBD cameras for 3D robot perception and manipulation in human environments
    G. Alenyà
    S. Foix
    C. Torras
    Intelligent Service Robotics, 2014, 7 : 211 - 220
  • [22] Heterogeneous Sensor Data Fusion: How Many Cameras Are Needed For An Accurate 3D Reconstruction of Indoor Scene?
    Xie, Meng
    Cooperstock, Jeremy R.
    2014 SEVENTH INTERNATIONAL SYMPOSIUM ON COMPUTATIONAL INTELLIGENCE AND DESIGN (ISCID 2014), VOL 2, 2014,
  • [23] 3D Body and Background Reconstruction in a Large-scale Indoor Scene using Multiple Depth Cameras
    Kobayashi, Daisuke
    Thomas, Diego
    Uchiyama, Hideaki
    Taniguchi, Rin-ichiro
    2019 12TH ASIA PACIFIC WORKSHOP ON MIXED AND AUGMENTED REALITY (APMAR), 2019, : 75 - 82
  • [24] Automatic and Accurate 3D Measurement Based on RGBD Saliency Detection
    Jiang, Yibo
    Bi, Hui
    Li, Hui
    Xu, Zhihao
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2019, E102D (03) : 688 - 689
  • [25] Using ToF and RGBD cameras for 3D robot perception and manipulation in human environments
    Alenya, G.
    Foix, S.
    Torras, C.
    INTELLIGENT SERVICE ROBOTICS, 2014, 7 (04) : 211 - 220
  • [26] Incremental Instance-Oriented 3D Semantic Mapping via RGB-D Cameras for Unknown Indoor Scene
    Li, Wei
    Gu, Junhua
    Chen, Benwen
    Han, Jungong
    DISCRETE DYNAMICS IN NATURE AND SOCIETY, 2020, 2020
  • [27] Learning 3D Semantic Scene Graphs from 3D Indoor Reconstructions
    Wald, Johanna
    Dhamo, Helisa
    Navab, Nassir
    Tombari, Federico
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 3960 - 3969
  • [28] RGBD Based Dimensional Decomposition Residual Network for 3D Semantic Scene Completion
    Li, Jie
    Liu, Yu
    Gong, Dong
    Shi, Qinfeng
    Yuan, Xia
    Zhao, Chunxia
    Reid, Ian
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 7685 - 7694
  • [29] Markerless 3D Human Pose Estimation and Tracking based on RGBD Cameras: an Experimental Evaluation
    Michel, Damien
    Qammaz, Ammar
    Argyros, Antonis A.
    10TH ACM INTERNATIONAL CONFERENCE ON PERVASIVE TECHNOLOGIES RELATED TO ASSISTIVE ENVIRONMENTS (PETRA 2017), 2017, : 115 - 122
  • [30] Automatic Scene Inference for 3D Object Compositing
    Karsch, Kevin
    Sunkavalli, Kalyan
    Hadap, Sunil
    Carr, Nathan
    Jin, Hailin
    Fonte, Rafael
    Sittig, Michael
    Forsyth, David
    ACM TRANSACTIONS ON GRAPHICS, 2014, 33 (03):