Overview of indoor scene recognition and representation methods based on multimodal knowledge graphs

被引:0
|
作者
Li, Jianxin [1 ]
Si, Guannan [1 ]
Tian, Pengxin [1 ]
An, Zhaoliang [1 ]
Zhou, Fengyu [2 ]
机构
[1] Shandong Jiaotong Univ, Sch Informat Sci & Elect Engn, Changqing Univ Sci Pk, Jinan 250357, Peoples R China
[2] Shandong Univ, Sch Control Sci & Engn, 17923 Jingshi Rd, Jinan 250061, Shandong, Peoples R China
基金
中国国家自然科学基金;
关键词
Knowledge graph; Scene graph; Neural network; Indoor entity recognition; IMAGE FUSION; PIXEL-LEVEL; ATTENTION; NETWORKS; SCALE;
D O I
10.1007/s10489-023-05235-7
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper provides a comprehensive overview of multi-modal knowledge graph technology and a three-layer framework for scene recognition. Integrating diverse 3D expertise into a deep neural network enhances scene cognition and knowledge representation. Real-time 3D scene graph construction via feature matching is explored, demonstrating the feasibility of effective scene knowledge representation. Leveraging advanced multimodal knowledge graph and scene recognition, the paper presents a promising avenue for AI-driven scene cognition and construction. It contributes to understanding multi-modal knowledge graph technology's potential in addressing scene recognition challenges and implications for future advancements. This interdisciplinary work establishes a foundation for intelligent scene analysis and interpretation.
引用
收藏
页码:899 / 923
页数:25
相关论文
共 50 条
  • [21] KNOWLEDGE-BASED MULTIMODAL DATA REPRESENTATION AND QUERYING
    Seinturier, Julien
    Murisasco, Elisabeth
    Bruno, Emmanuel
    KEOD 2011: PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON KNOWLEDGE ENGINEERING AND ONTOLOGY DEVELOPMENT, 2011, : 152 - 158
  • [22] Knowledge Base Completion Based on Multimodal Representation Learning
    Wang J.
    Su H.
    Lai X.
    Moshi Shibie yu Rengong Zhineng/Pattern Recognition and Artificial Intelligence, 2021, 34 (01): : 33 - 43
  • [23] SemanticFormer: Holistic and Semantic Traffic Scene Representation for Trajectory Prediction Using Knowledge Graphs
    Sun, Zhigang
    Wang, Zixu
    Halilaj, Lavdim
    Luettin, Juergen
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2024, 9 (09): : 7381 - 7388
  • [24] Hierarchical Context-Based Emotion Recognition With Scene Graphs
    Wu, Shichao
    Zhou, Lei
    Hu, Zhengxi
    Liu, Jingtai
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (03) : 3725 - 3739
  • [25] A Novel Knowledge Representation Based on Fuzzy Conceptual Graphs
    Liu, Peiqi
    FUZZY SYSTEMS, KNOWLEDGE DISCOVERY AND NATURAL COMPUTATION SYMPOSIUM (FSKDNC 2013), 2013, : 196 - 205
  • [26] The Multimodal Scene Recognition Method Based on Self-Attention and Distillation
    Sun, Ning
    Xu, Wei
    Liu, Jixin
    Chai, Lei
    Sun, Haian
    IEEE MULTIMEDIA, 2024, 31 (04) : 25 - 36
  • [27] An indoor scene recognition system based on deep learning evolutionary algorithms
    Mouna Afif
    Riadh Ayachi
    Yahia Said
    Mohamed Atri
    Soft Computing, 2023, 27 : 15581 - 15594
  • [28] An indoor scene recognition system based on deep learning evolutionary algorithms
    Afif, Mouna
    Ayachi, Riadh
    Said, Yahia
    Atri, Mohamed
    SOFT COMPUTING, 2023, 27 (21) : 15581 - 15594
  • [29] Nearest-Neighbor based Metric Functions for indoor scene recognition
    Cakir, Fatih
    Gudukbay, Ugur
    Ulusoy, Ozgur
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2011, 115 (11) : 1483 - 1492
  • [30] Indoor localization system using deep learning based scene recognition
    Boney A. Labinghisa
    Dong Myung Lee
    Multimedia Tools and Applications, 2022, 81 : 28405 - 28429