Active Arrangement of Small Objects in 3D Indoor Scenes

被引:2
|
作者
Zhang, Suiyun [1 ,2 ]
Han, Zhizhong [3 ]
Lai, Yu-Kun [4 ]
Zwicker, Matthias [3 ]
Zhang, Hui [1 ,2 ]
机构
[1] Tsinghua Univ, Sch Software, Beijing 100084, Peoples R China
[2] Beijing Natl Res Ctr Informat Sci & Technol BNRis, Beijing, Peoples R China
[3] Univ Maryland, Dept Comp Sci, College Pk, MD 20742 USA
[4] Cardiff Univ, Sch Comp Sci & Informat, Cardiff CF10 3AT, Wales
基金
美国国家科学基金会; 中国国家自然科学基金;
关键词
Three-dimensional displays; Shape; Solid modeling; Learning systems; Computer graphics; Data mining; Neural networks; 3D object layout; active learning; scene enrichment; computer-aided aesthetic design; human computer interaction;
D O I
10.1109/TVCG.2019.2949295
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Small object arrangement is very important for creating detailed and realistic 3D indoor scenes. In this article, we present an interactive framework based on active learning to help users create customized arrangements for small objects according to their preferences. To achieve this with minimal user effort, we first learn the prior knowledge about small object arrangement from a 3D indoor scene dataset through a probability mining method, which forms the initial guidance for arranging small objects. Then, users are able to express their preferences on a few small object categories, which are automatically propagated to all the other categories via a novel active learning approach. In the propagation process, we introduce a novel metric to obtain the propagation weights, which measures the degree of interchangeability between two small object categories, and is calculated based on a spatial embedding model learned from the small object neighborhood information extracted from the 3D indoor scene dataset. Experiments show that our framework is able to help users effectively create customized small object arrangements with little effort.
引用
收藏
页码:2250 / 2264
页数:15
相关论文
共 50 条
  • [1] Active 3D Classification of Multiple Objects in Cluttered Scenes
    Wang, Yiming
    Carletti, Marco
    Setti, Francesco
    Cristani, Marco
    Del Bue, Alessio
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2019, : 2602 - 2610
  • [2] Indoor Objects and Outdoor Urban Scenes Recognition by 3D Visual Primitives
    Fu, Junsheng
    Kamarainen, Joni-Kristian
    Buch, Anders Glent
    Kruger, Norbert
    [J]. COMPUTER VISION - ACCV 2014 WORKSHOPS, PT I, 2015, 9008 : 270 - 285
  • [3] Lighting Layout Optimization for 3D Indoor Scenes
    Jin, Sam
    Lee, Sung-Hee
    [J]. COMPUTER GRAPHICS FORUM, 2019, 38 (07) : 733 - 743
  • [4] Simple and Effective Synthesis of Indoor 3D Scenes
    Koh, Jing Yu
    Agrawal, Harsh
    Batra, Dhruv
    Tucker, Richard
    Waters, Austin
    Lee, Honglak
    Yang, Yinfei
    Baldridge, Jason
    Anderson, Peter
    [J]. THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 1, 2023, : 1169 - 1178
  • [5] 3D Arrangement of LEDs for Indoor VLC Applications
    Halim, Chouabia
    Abdesselam, Babouri
    Abdelaziz, Ladjimi
    Ameur, Chaabna
    Xun, Zhang
    [J]. 2020 IEEE INTERNATIONAL SYMPOSIUM ON BROADBAND MULTIMEDIA SYSTEMS AND BROADCASTING (BMSB), 2020,
  • [6] Objects layout graph for 3D complex scenes
    Adán, A
    Merchán, P
    Salamanca, S
    Vázquez, A
    Adán, M
    Cerrada, C
    [J]. 2005 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), VOLS 1-5, 2005, : 2881 - 2884
  • [7] Retargeting 3D Objects and Scenes with a General Framework
    Huang, Chun-Kai
    Chen, Yi-Ling
    Shen, I-Chao
    Chen, Bing-Yu
    [J]. COMPUTER GRAPHICS FORUM, 2016, 35 (07) : 33 - 42
  • [8] 3D recognition and segmentation of objects in cluttered scenes
    Mian, AS
    Bennamoun, M
    Owens, RA
    [J]. WACV 2005: SEVENTH IEEE WORKSHOP ON APPLICATIONS OF COMPUTER VISION, PROCEEDINGS, 2005, : 8 - 13
  • [9] 3d vision of small objects
    Jin, GC
    Ma, SP
    [J]. VISUALIZATION AND OPTIMIZATION TECHNIQUES, 2001, 4553 : 116 - 120
  • [10] Label Propagation for Large Scale 3D Indoor Scenes
    Tang, Keke
    Zhao, Zhe
    Chen, Xiaoping
    [J]. ADVANCES IN VISUAL COMPUTING, PT I (ISVC 2015), 2015, 9474 : 253 - 264