Manhattan Room Layout Reconstruction from a Single 360∘\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$360^{\circ }$$\end{document} Image: A Comparative Study of State-of-the-Art Methods

被引:0
|
作者
Chuhang Zou
Jheng-Wei Su
Chi-Han Peng
Alex Colburn
Qi Shan
Peter Wonka
Hung-Kuo Chu
Derek Hoiem
机构
[1] University of Illinois at Urbana-Champaign,
[2] National Tsing Hua University,undefined
[3] National Chiao Tung University,undefined
[4] ShanghaiTech University,undefined
[5] University of Washington,undefined
[6] Apple Inc.,undefined
[7] King Abdullah University of Science and Technology,undefined
关键词
3D room layout; Deep learning; Single image 3D; Manhattan world;
D O I
10.1007/s11263-020-01426-8
中图分类号
学科分类号
摘要
Recent approaches for predicting layouts from 360∘\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$^{\circ }$$\end{document} panoramas produce excellent results. These approaches build on a common framework consisting of three steps: a pre-processing step based on edge-based alignment, prediction of layout elements, and a post-processing step by fitting a 3D layout to the layout elements. Until now, it has been difficult to compare the methods due to multiple different design decisions, such as the encoding network (e.g., SegNet or ResNet), type of elements predicted (e.g., corners, wall/floor boundaries, or semantic segmentation), or method of fitting the 3D layout. To address this challenge, we summarize and describe the common framework, the variants, and the impact of the design decisions. For a complete evaluation, we also propose extended annotations for the Matterport3D dataset (Chang et al.: Matterport3d: learning from rgb-d data in indoor environments. arXiv:1709.06158, 2017), and introduce two depth-based evaluation metrics.
引用
收藏
页码:1410 / 1431
页数:21
相关论文
共 50 条