Explore Contextual Information for 3D Scene Graph Generation

被引:6
|
作者
Liu, Yuanyuan [1 ]
Long, Chengjiang [2 ]
Zhang, Zhaoxuan [1 ]
Liu, Bokai [1 ]
Zhang, Qiang [3 ,4 ]
Yin, Baocai [3 ,5 ]
Yang, Xin [1 ]
机构
[1] Dalian Univ Technol, Dept Elect Informat & Elect Engn, Dalian 116024, Peoples R China
[2] Meta Real Labs, Burlingame, CA 94010 USA
[3] Dalian Univ Technol, Dept Elect Informat & Elect Engn, Dalian 116024, Peoples R China
[4] Dalian Univ, Minist Educ, Key Lab Adv Design & Intelligent Comp, Dalian 116622, Peoples R China
[5] Beijing Univ Technol, Fac Informat Technol, Beijing Inst Artificial Intelligence, Beijing Key Lab Multimedia & Intelligent Software, Beijing 100124, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Three-dimensional displays; Task analysis; Visualization; Skeleton; Cognition; Message passing; Context exploration; graph skeleton; scene graph generation; scene understanding; NETWORK;
D O I
10.1109/TVCG.2022.3219451
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
3D scene graph generation (SGG) has been of high interest in computer vision. Although the accuracy of 3D SGG on coarse classification and single relation label has been gradually improved, the performance of existing works is still far from being perfect for fine-grained and multi-label situations. In this article, we propose a framework fully exploring contextual information for the 3D SGG task, which attempts to satisfy the requirements of fine-grained entity class, multiple relation labels, and high accuracy simultaneously. Our proposed approach is composed of a Graph Feature Extraction module and a Graph Contextual Reasoning module, achieving appropriate information-redundancy feature extraction, structured organization, and hierarchical inferring. Our approach achieves superior or competitive performance over previous methods on the 3DSSG dataset, especially on the relationship prediction sub-task.
引用
收藏
页码:5556 / 5568
页数:13
相关论文
共 50 条
  • [1] Boosting Scene Graph Generation with Contextual Information
    Sun, Shiqi
    Huang, Danlan
    Tao, Xiaoming
    Pan, Chengkang
    Liu, Guangyi
    Chen, Changwen
    [J]. ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2024, 20 (02)
  • [2] Scene Graph Masked Variational Autoencoders for 3D Scene Generation
    Xu, Rui
    Hui, Le
    Han, Yuehui
    Qian, Jianjun
    Xie, Jin
    [J]. PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 5725 - 5733
  • [3] Scene Graph with 3D Information for Change Captioning
    Liao, Zeming
    Huang, Qingbao
    Liang, Yu
    Fu, Mingyi
    Cai, Yi
    Li, Qing
    [J]. PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 5074 - 5082
  • [4] 3D Scene Graph Generation From Point Clouds
    Wei, Wenwen
    Wei, Ping
    Qin, Jialu
    Liao, Zhimin
    Wang, Shuaijie
    Cheng, Xiang
    Liu, Meiqin
    Zheng, Nanning
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 5358 - 5368
  • [5] Prediction and Generation of 3D Functional Scene Based on Relation Graph
    Sun, Qian
    Hu, Ruizhen
    [J]. Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2022, 34 (09): : 1351 - 1361
  • [6] Dynamic 3d scene graph generation for robotic manipulation tasks
    Jung, Ga Young
    Kim, Incheol
    [J]. Journal of Institute of Control, Robotics and Systems, 2021, 27 (12) : 953 - 963
  • [7] CONTEXTUAL LABEL TRANSFORMATION FOR SCENE GRAPH GENERATION
    Lee, Wonhee
    Kim, Sungeun
    Kim, Gunhee
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 2533 - 2537
  • [8] SGFormer: Semantic Graph Transformer for Point Cloud-Based 3D Scene Graph Generation
    Lv, Changsheng
    Qi, Mengshi
    Li, Xia
    Yang, Zhengyuan
    Ma, Huadong
    [J]. THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 5, 2024, : 4035 - 4043
  • [9] Automatic Generation of 3D Scene Animation Based on Dynamic Knowledge Graphs and Contextual Encoding
    Wenfeng, Song
    Xinyu, Zhang
    Yuting, Guo
    Shuai, Li
    Aimin, Hao
    Hong, Qin
    [J]. INTERNATIONAL JOURNAL OF COMPUTER VISION, 2023, 131 (11) : 2816 - 2844
  • [10] Automatic Generation of 3D Scene Animation Based on Dynamic Knowledge Graphs and Contextual Encoding
    Wenfeng Song
    Xinyu Zhang
    Yuting Guo
    Shuai Li
    Aimin Hao
    Hong Qin
    [J]. International Journal of Computer Vision, 2023, 131 : 2816 - 2844