Metaknowledge Extraction Based on Multi-Modal Documents

被引:3
|
作者
Liu, Shu-Kan [1 ,2 ]
Xu, Rui-Lin [2 ]
Geng, Bo-Ying [2 ]
Sun, Qiao [2 ,3 ]
Duan, Li [2 ]
Liu, Yi-Ming [2 ]
机构
[1] Southeast Univ, Sch Comp Sci & Engn, Nanjing 211189, Peoples R China
[2] PLA Naval Univ Engn, Sch Elect Engn, Wuhan 430033, Peoples R China
[3] Zhejiang Univ, Coll Comp Sci & Technol, Hangzhou 310058, Peoples R China
关键词
Task analysis; Optical character recognition software; Layout; Object detection; Semantics; Knowledge based systems; Computational modeling; Metaknowledge; multi-modal; document layout analysis; knowledge graph;
D O I
10.1109/ACCESS.2021.3068728
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The triplet-based knowledge in large-scale knowledge bases is most likely lacking in structural logic and problematic of conducting knowledge hierarchy. In this paper, we introduce the concept of metaknowledge to knowledge engineering research for the purpose of structural knowledge construction. Therefore, the Metaknowledge Extraction Framework and Document Structure Tree model are presented to extract and organize metaknowledge elements (titles, authors, abstracts, sections, paragraphs, etc.), so that it is feasible to extract the structural knowledge from multi-modal documents. Experiment results have proved the effectiveness of metaknowledge elements extraction by our framework. Meanwhile, detailed examples are given to demonstrate what exactly metaknowledge is and how to generate it. At the end of this paper, we propose and analyze the task flow of metaknowledge applications and the associations between knowledge and metaknowledge.
引用
收藏
页码:50050 / 50060
页数:11
相关论文
共 50 条
  • [1] Research on structural knowledge extraction and organization for multi-modal governmental documents
    Xu, Ruilin
    Geng, Boying
    Liu, Shukan
    [J]. Xi Tong Gong Cheng Yu Dian Zi Ji Shu/Systems Engineering and Electronics, 2022, 44 (07): : 2241 - 2250
  • [2] Extractive summarization of documents with images based on multi-modal RNN
    Chen, Jingqiang
    Hai Zhuge
    [J]. FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2019, 99 : 186 - 196
  • [3] Multi-modal browsing of images in Web documents
    Chen, F
    Gargi, U
    Niles, L
    Schütze, H
    [J]. DOCUMENT RECOGNITION AND RETRIEVAL VI, 1999, 3651 : 122 - 133
  • [4] Multi-Modal Association based Grouping for Form Structure Extraction
    Aggarwal, Milan
    Sarkar, Mausoom
    Gupta, Hiresh
    Krishnamurthy, Balaji
    [J]. 2020 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2020, : 2064 - 2073
  • [5] Multi-Modal Military Event Extraction Based on Knowledge Fusion
    Xiang, Yuyuan
    Jia, Yangli
    Zhang, Xiangliang
    Zhang, Zhenling
    [J]. CMC-COMPUTERS MATERIALS & CONTINUA, 2023, 77 (01): : 97 - 114
  • [6] AMM: Towards adaptive ranking of multi-modal documents
    Akbari M.
    Nie L.
    Chua T.-S.
    [J]. International Journal of Multimedia Information Retrieval, 2015, 4 (4) : 233 - 245
  • [7] LIMUSE: LIGHTWEIGHT MULTI-MODAL SPEAKER EXTRACTION
    Liu, Qinghua
    Huang, Yating
    Hao, Yunzhe
    Xu, Jiaming
    Xu, Bo
    [J]. 2022 IEEE SPOKEN LANGUAGE TECHNOLOGY WORKSHOP, SLT, 2022, : 488 - 495
  • [8] A framework for creating customized multi-modal interfaces for XML documents
    Rollins, S
    Sundaresan, N
    [J]. 2000 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, PROCEEDINGS VOLS I-III, 2000, : 933 - 936
  • [9] Endmember Bundle Extraction Method Based on Multi-modal and Multi-objective Optimization
    Lin, Jiewen
    Chen, Jian
    Luo, Tingwen
    Xu, Zhibo
    [J]. Nongye Jixie Xuebao/Transactions of the Chinese Society for Agricultural Machinery, 2023, 54 (07): : 234 - 242
  • [10] Multi-modal, Multi-labeled Sports Highlight Extraction
    He, Jiabin
    Pao, Hsing-Kuo
    [J]. 2020 25TH INTERNATIONAL CONFERENCE ON TECHNOLOGIES AND APPLICATIONS OF ARTIFICIAL INTELLIGENCE (TAAI 2020), 2020, : 181 - 186