Richpedia: A Large-Scale, Comprehensive Multi-Modal Knowledge Graph

被引:41
|
作者
Wang, Meng [1 ,2 ]
Wang, Haofen [3 ]
Qi, Guilin [1 ,2 ]
Zheng, Qiushuo [4 ]
机构
[1] Southeast Univ, Sch Comp Sci & Engn, Nanjing, Peoples R China
[2] Southeast Univ, Minist Educ, Key Lab Comp Network & Informat Integrat, Nanjing, Peoples R China
[3] Tongji Univ, Intelligent Big Data Visualizat Lab, Shanghai, Peoples R China
[4] Southeast Univ, Sch Cyber Sci & Engn, Nanjing, Peoples R China
基金
中国国家自然科学基金;
关键词
Knowledge graph; Multi-modal; Wikidata; Ontology; LANGUAGE;
D O I
10.1016/j.bdr.2020.100159
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Large-scale knowledge graphs such as Wikidata and DBpedia have become a powerful asset for semantic search and question answering. However, most of the knowledge graph construction works focus on organizing and discovering textual knowledge in a structured representation, while paying little attention to the proliferation of visual resources on the Web. To consolidate this recent trend, in this paper, we present Richpedia, aiming to provide a comprehensive multi-modal knowledge graph by distributing sufficient and diverse images to textual entities in Wikidata. We also set Resource Description Framework links (visual semantic relations) between image entities based on the hyperlinks and descriptions in Wikipedia. The Richpedia resource is accessible on the Web via a faceted query endpoint, which provides a pathway for knowledge graph and computer vision tasks, such as link prediction and visual relation detection. (C) 2020 Elsevier Inc. All rights reserved.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] Richpedia: A Comprehensive Multi-modal Knowledge Graph
    Wang, Meng
    Qi, Guilin
    Wang, Haofen
    Zheng, Qiushuo
    [J]. SEMANTIC TECHNOLOGY, JIST 2019: PROCEEDINGS, 2020, 12032 : 130 - 145
  • [2] MMpedia: A Large-Scale Multi-modal Knowledge Graph
    Wu, Yinan
    Wu, Xiaowei
    Li, Junwen
    Zhang, Yue
    Wang, Haofen
    Du, Wen
    He, Zhidong
    Liu, Jingping
    Ruan, Tong
    [J]. SEMANTIC WEB, ISWC 2023, PT II, 2023, 14266 : 18 - 37
  • [3] Beyond Entities: A Large-Scale Multi-Modal Knowledge Graph with Triplet Fact Grounding
    Liu, Jingping
    Zhang, Mingchuan
    Li, Weichen
    Wang, Chao
    Li, Shuang
    Jiang, Haiyun
    Jiang, Sihang
    Xiao, Yanghua
    Chen, Yunwen
    [J]. THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 17, 2024, : 18653 - 18661
  • [4] Efficient Large-Scale Multi-Modal Classification
    Kiela, Douwe
    Grave, Edouard
    Joulin, Armand
    Mikolov, Tomas
    [J]. THIRTY-SECOND AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTIETH INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / EIGHTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2018, : 5198 - 5204
  • [5] Large-scale Multi-modal Pre-trained Models: A Comprehensive Survey
    Xiao Wang
    Guangyao Chen
    Guangwu Qian
    Pengcheng Gao
    Xiao-Yong Wei
    Yaowei Wang
    Yonghong Tian
    Wen Gao
    [J]. Machine Intelligence Research, 2023, 20 : 447 - 482
  • [6] Large-scale Multi-modal Pre-trained Models: A Comprehensive Survey
    Wang, Xiao
    Chen, Guangyao
    Qian, Guangwu
    Gao, Pengcheng
    Wei, Xiao-Yong
    Wang, Yaowei
    Tian, Yonghong
    Gao, Wen
    [J]. MACHINE INTELLIGENCE RESEARCH, 2023, 20 (04) : 447 - 482
  • [7] Large-scale Multi-modal Search and QA at Alibaba
    Jin, Rong
    [J]. PROCEEDINGS OF THE 43RD INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL (SIGIR '20), 2020, : 8 - 8
  • [8] Research and Comprehensive Review on Multi-Modal Knowledge Graph Fusion Techniques
    Chen, Youren
    Li, Yong
    Wen, Ming
    Sun, Chi
    [J]. Computer Engineering and Applications, 2024, 60 (13) : 36 - 50
  • [9] Leveraging Multi-modal Prior Knowledge for Large-scale Concept Learning in NoisyWeb Data
    Liang, Junwei
    Jiang, Lu
    Meng, Deyu
    Hauptmann, Alexander
    [J]. PROCEEDINGS OF THE 2017 ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA RETRIEVAL (ICMR'17), 2017, : 32 - 40
  • [10] Exploring a large-scale multi-modal transportation recommendation system
    Liu, Yang
    Lyu, Cheng
    Liu, Zhiyuan
    Cao, Jinde
    [J]. TRANSPORTATION RESEARCH PART C-EMERGING TECHNOLOGIES, 2021, 126