Explore Contextual Information for 3D Scene Graph Generation

被引:6
|
作者
Liu, Yuanyuan [1 ]
Long, Chengjiang [2 ]
Zhang, Zhaoxuan [1 ]
Liu, Bokai [1 ]
Zhang, Qiang [3 ,4 ]
Yin, Baocai [3 ,5 ]
Yang, Xin [1 ]
机构
[1] Dalian Univ Technol, Dept Elect Informat & Elect Engn, Dalian 116024, Peoples R China
[2] Meta Real Labs, Burlingame, CA 94010 USA
[3] Dalian Univ Technol, Dept Elect Informat & Elect Engn, Dalian 116024, Peoples R China
[4] Dalian Univ, Minist Educ, Key Lab Adv Design & Intelligent Comp, Dalian 116622, Peoples R China
[5] Beijing Univ Technol, Fac Informat Technol, Beijing Inst Artificial Intelligence, Beijing Key Lab Multimedia & Intelligent Software, Beijing 100124, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Three-dimensional displays; Task analysis; Visualization; Skeleton; Cognition; Message passing; Context exploration; graph skeleton; scene graph generation; scene understanding; NETWORK;
D O I
10.1109/TVCG.2022.3219451
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
3D scene graph generation (SGG) has been of high interest in computer vision. Although the accuracy of 3D SGG on coarse classification and single relation label has been gradually improved, the performance of existing works is still far from being perfect for fine-grained and multi-label situations. In this article, we propose a framework fully exploring contextual information for the 3D SGG task, which attempts to satisfy the requirements of fine-grained entity class, multiple relation labels, and high accuracy simultaneously. Our proposed approach is composed of a Graph Feature Extraction module and a Graph Contextual Reasoning module, achieving appropriate information-redundancy feature extraction, structured organization, and hierarchical inferring. Our approach achieves superior or competitive performance over previous methods on the 3DSSG dataset, especially on the relationship prediction sub-task.
引用
收藏
页码:5556 / 5568
页数:13
相关论文
共 50 条
  • [21] 3D scene graph prediction from point clouds
    Wu, Fanfan
    Yan, Feihu
    Shi, Weimin
    Zhou, Zhong
    [J]. Virtual Reality and Intelligent Hardware, 2022, 4 (01): : 76 - 88
  • [22] 3D scene graph prediction from point clouds
    Fanfan WU
    Feihu YAN
    Weimin SHI
    Zhong ZHOU
    [J]. 虚拟现实与智能硬件(中英文), 2022, 4 (01) : 76 - 88
  • [23] 3D Scene Generation by Learning from Examples
    Dema, Mesfin A.
    Sari-Sarraf, Hamed
    [J]. 2012 IEEE INTERNATIONAL SYMPOSIUM ON MULTIMEDIA (ISM), 2012, : 58 - 64
  • [24] Automatic 3D Scene Generation Based on Maya
    Li, Canlin
    Yin, Chao
    Lu, Jiajie
    Ma, Lizhuang
    [J]. 2009 IEEE 10TH INTERNATIONAL CONFERENCE ON COMPUTER-AIDED INDUSTRIAL DESIGN & CONCEPTUAL DESIGN, VOLS 1-3: E-BUSINESS, CREATIVE DESIGN, MANUFACTURING - CAID&CD'2009, 2009, : 981 - 985
  • [25] Knowledge-Based Scene Graph Generation with Visual Contextual Dependency
    Zhang, Lizong
    Yin, Haojun
    Hui, Bei
    Liu, Sijuan
    Zhang, Wei
    [J]. MATHEMATICS, 2022, 10 (14)
  • [26] The development of a language interface for 3d scene generation
    Zeng, Xin
    Tan, Manling
    [J]. PROCEEDINGS OF THE SECOND IASTED INTERNATIONAL CONFERENCE ON HUMAN-COMPUTER INTERACTION, 2007, : 136 - 141
  • [27] Contextual Translation Embedding for Visual Relationship Detection and Scene Graph Generation
    Hung, Zih-Siou
    Mallya, Arun
    Lazebnik, Svetlana
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (11) : 3820 - 3832
  • [28] SceneHGN: Hierarchical Graph Networks for 3D Indoor Scene Generation With Fine-Grained Geometry
    Gao, Lin
    Sun, Jia-Mu
    Mo, Kaichun
    Lai, Yu-Kun
    Guibas, Leonidas J.
    Yang, Jie
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (07) : 8902 - 8919
  • [29] Learning Graph Variational Autoencoders with Constraints and Structured Priors for Conditional Indoor 3D Scene Generation
    Chattopadhyay, Aditya
    Zhang, Xi
    Wipf, David Paul
    Arora, Himanshu
    Vidal, Rene
    [J]. 2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, : 785 - 794
  • [30] Indoor and Outdoor 3D Scene Graph Generation Via Language-Enabled Spatial Ontologies
    Strader, Jared
    Hughes, Nathan
    Chen, William
    Speranzon, Alberto
    Carlone, Luca
    [J]. IEEE ROBOTICS AND AUTOMATION LETTERS, 2024, 9 (06): : 4886 - 4893