Deep style estimator for 3D indoor object collection organization and scene synthesis

被引:3
|
作者
Wang, Xiaotian [1 ]
Zhou, Bin [1 ]
Zhang, Yu [1 ]
Zhao, Yifan [1 ]
机构
[1] Beihang Univ, State Key Lab Virtual Real Technol & Syst, Beijing 100191, Peoples R China
来源
COMPUTERS & GRAPHICS-UK | 2018年 / 74卷
基金
中国国家自然科学基金;
关键词
Style estimator; Deep neural network; Collection organization; Scene suggestion;
D O I
10.1016/j.cag.2018.05.008
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Estimating the style compatibility between a pair of cross-category 3D indoor objects has received wide interests from the field of computer graphics in these years. Many previous works solve this task by extracting and analyzing the style-aware structures or elements from the input 3D models. In this paper, we propose a novel approach to solve this task by training a deep neural network to quantitatively assign a compatibility score between arbitrary pair of cross-category 3D objects. By entirely learning from raw data, the trained network is able to capture various compatibility conditions influenced by global style features, such as ergonomics and object category relation. The proposed deep estimator is generally robust and can facilitate various high-level tasks. We first show its application for object collection organization. After that, we show how layout-guided, style-consistent object retrieval for indoor scene synthesis can be achieved by integrating pairwise style estimations into a novel submodular formulation. Our experiments demonstrate the usability of the proposed approach, demonstrating results superior than previous works and even comparable with suggestions made by human observers. (C) 2018 Elsevier Ltd. All rights reserved.
引用
收藏
页码:76 / 84
页数:9
相关论文
共 50 条
  • [1] 3D Scene Reconstruction and Object Recognition for Indoor Scene
    Shen, Yangping
    Manabe, Yoshitsugu
    Yata, Noriko
    INTERNATIONAL WORKSHOP ON ADVANCED IMAGE TECHNOLOGY (IWAIT) 2019, 2019, 11049
  • [2] StyleMesh: Style Transfer for Indoor 3D Scene Reconstructions
    Hoellein, Lukas
    Johnson, Justin
    Niessner, Matthias
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 6188 - 6198
  • [3] A Survey of 3D Indoor Scene Synthesis
    Song-Hai Zhang
    Shao-Kui Zhang
    Yuan Liang
    Peter Hall
    Journal of Computer Science and Technology, 2019, 34 : 594 - 608
  • [4] A Survey of 3D Indoor Scene Synthesis
    Zhang, Song-Hai
    Zhang, Shao-Kui
    Liang, Yuan
    Hall, Peter
    JOURNAL OF COMPUTER SCIENCE AND TECHNOLOGY, 2019, 34 (03) : 594 - 608
  • [5] Text to Scene: A System of Configurable 3D Indoor Scene Synthesis
    Yang, Xinyan
    Hu, Fei
    Ye, Long
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 2819 - 2821
  • [6] Deep Generative Modeling Based on VAE-GAN for 3D Indoor Scene Synthesis
    Li, Shuai
    Li, Hongjun
    INTERNATIONAL JOURNAL OF COMPUTER GAMES TECHNOLOGY, 2023, 2023
  • [7] Indoor Scene Recognition in 3D
    Huang, Shengyu
    Usvyatsov, Mikhail
    Schindler, Konrad
    2020 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2020, : 8041 - 8048
  • [8] 3D Indoor Scene Synthesis System Based on Collaborative Retrieval
    Yu Weijun
    WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2022, 2022
  • [9] Deep Model Style: Cross-class Style Compatibility for 3D Furniture within a Scene
    Pan, Tse-Yu
    Dai, Yi-Zhu
    Tsai, Wan-Lun
    Hu, Min-Chun
    2017 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2017, : 4307 - 4313
  • [10] Automatic 3D object placement for 3D scene generation
    Akazawa, Y
    Okada, Y
    Niijima, K
    MODELLING AND SIMULATION 2003, 2003, : 316 - 318