Automatic 3D Indoor Scene Updating with RGBD Cameras

被引:5
|
作者
Liu, Zhenbao [1 ]
Tang, Sicong [1 ]
Xu, Weiwei [2 ]
Bu, Shuhui [1 ]
Han, Junwei [1 ]
Zhou, Kun [3 ]
机构
[1] Northwestern Polytech Univ, Xian, Peoples R China
[2] Hangzhou Normal Univ, Hangzhou, Zhejiang, Peoples R China
[3] Zhejiang Univ, Hangzhou, Zhejiang, Peoples R China
关键词
Categories and Subject Descriptors (according to ACM CCS); I; 3; 5 [Computer Graphics]: Computational Geometry and Object Modeling;
D O I
10.1111/cgf.12495
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Since indoor scenes are frequently changed in daily life, such as re-layout of furniture, the 3D reconstructions for them should be flexible and easy to update. We present an automatic 3D scene update algorithm to indoor scenes by capturing scene variation with RGBD cameras. We assume an initial scene has been reconstructed in advance in manual or other semi-automatic way before the change, and automatically update the reconstruction according to the newly captured RGBD images of the real scene update. It starts with an automatic segmentation process without manual interaction, which benefits from accurate labeling training from the initial 3D scene. After the segmentation, objects captured by RGBD camera are extracted to form a local updated scene. We formulate an optimization problem to compare to the initial scene to locate moved objects. The moved objects are then integrated with static objects in the initial scene to generate a new 3D scene. We demonstrate the efficiency and robustness of our approach by updating the 3D scene of several real-world scenes.
引用
收藏
页码:269 / 278
页数:10
相关论文
共 50 条
  • [1] Holistic Scene Understanding for 3D Object Detection with RGBD cameras
    Lin, Dahua
    Fidler, Sanja
    Urtasun, Raquel
    2013 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2013, : 1417 - 1424
  • [2] An Effective 3D Instance Map Reconstruction Method Based on RGBD Images for Indoor Scene
    Wu, Heng
    Liu, Yanjie
    Wang, Chao
    Wei, Yanlong
    Remote Sensing, 2025, 17 (01)
  • [3] Automatic 3D Indoor Scene Modeling from Single Panorama
    Yang, Yang
    Jin, Shi
    Liu, Ruiyang
    Kang, Sing Bing
    Yu, Jingyi
    2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 3926 - 3934
  • [4] Complete 3D Scene Parsing from an RGBD Image
    Zou, Chuhang
    Guo, Ruiqi
    Li, Zhizhong
    Hoiem, Derek
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2019, 127 (02) : 143 - 162
  • [5] Complete 3D Scene Parsing from an RGBD Image
    Chuhang Zou
    Ruiqi Guo
    Zhizhong Li
    Derek Hoiem
    International Journal of Computer Vision, 2019, 127 : 143 - 162
  • [6] Indoor Scene Recognition in 3D
    Huang, Shengyu
    Usvyatsov, Mikhail
    Schindler, Konrad
    2020 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2020, : 8041 - 8048
  • [7] Automatic Loop Closure Detection Using Multiple Cameras for 3D Indoor Localization
    Kua, John
    Corso, Nicholas
    Zakhor, Avideh
    COMPUTATIONAL IMAGING X, 2012, 8296
  • [8] High-quality indoor scene 3D reconstruction with RGB-D cameras: A brief review
    Li, Jianwei
    Gao, Wei
    Wu, Yihong
    Liu, Yangdong
    Shen, Yanfei
    COMPUTATIONAL VISUAL MEDIA, 2022, 8 (03) : 369 - 393
  • [9] High-quality indoor scene 3D reconstruction with RGB-D cameras: A brief review
    Jianwei Li
    Wei Gao
    Yihong Wu
    Yangdong Liu
    Yanfei Shen
    Computational Visual Media, 2022, 8 : 369 - 393
  • [10] High-quality indoor scene 3D reconstruction with RGB-D cameras: A brief review
    Jianwei Li
    Wei Gao
    Yihong Wu
    Yangdong Liu
    Yanfei Shen
    Computational Visual Media, 2022, 8 (03) : 369 - 393