MKEAH: Multimodal knowledge extraction and accumulation based on hyperplane embedding for knowledge-based visual question answering

被引:0
|
作者
Zhang, Heng [1 ]
Wei, Zhihua [1 ]
Liu, Guanming [1 ]
Wang, Rui [1 ]
Mu, Ruibin [2 ]
Liu, Chuanbao [2 ]
Yuan, Aiquan [2 ]
Cao, Guodong [2 ]
Hu, Ning [2 ]
机构
[1] Tongji University, Shanghai,2000092, China
[2] Alibaba Group, Shanghai,200030, China
关键词
Embeddings - Hyperplane - Knowledge accumulation - Knowledge based - Knowledge extraction - Knowledge-based visual question answering - Knowledge-representation - Multi-modal - Question Answering - Topic-related;
D O I
暂无
中图分类号
学科分类号
摘要
48
引用
收藏
页码:280 / 291
相关论文
共 50 条
  • [41] A Relateness-Based Ranking Method for Knowledge-Based Question Answering
    Ni, Han
    Lin, Liansheng
    Xu, Ge
    NATURAL LANGUAGE PROCESSING AND CHINESE COMPUTING, NLPCC 2018, PT II, 2018, 11109 : 393 - 400
  • [42] UHop: An Unrestricted-Hop Relation Extraction Framework for Knowledge-Based Question Answering
    Chen, Zi-Yuan
    Chang, Chih-Hung
    Chen, Yi-Pei
    Nayak, Jijnasa
    Ku, Lun-Wei
    2019 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES (NAACL HLT 2019), VOL. 1, 2019, : 345 - 356
  • [43] Cross-modality Multiple Relations Learning for Knowledge-based Visual Question Answering
    Wang, Yan
    Li, Peize
    Si, Qingyi
    Zhang, Hanwen
    Zang, Wenyu
    Lin, Zheng
    Fu, Peng
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2024, 20 (03)
  • [44] Inner Knowledge-based Img2Doc Scheme for Visual Question Answering
    Li, Qun
    Xiao, Fu
    Bhanu, Bir
    Sheng, Biyun
    Hong, Richang
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2022, 18 (03)
  • [45] Prompting Large Language Models with Answer Heuristics for Knowledge-based Visual Question Answering
    Shao, Zhenwei
    Yu, Zhou
    Wang, Meng
    Yu, Jun
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 14974 - 14983
  • [46] Weakly-Supervised Visual-Retriever-Reader for Knowledge-based Question Answering
    Luo, Man
    Zeng, Yankai
    Banerjee, Pratyay
    Baral, Chitta
    2021 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2021), 2021, : 6417 - 6431
  • [47] Knowledge-Based Visual Question Answering Using Multi-Modal Semantic Graph
    Jiang, Lei
    Meng, Zuqiang
    ELECTRONICS, 2023, 12 (06)
  • [48] Image captioning for effective use of language models in knowledge-based visual question answering
    Salaberria, Ander
    Azkune, Gorka
    Lacalle, Oier Lopez de
    Soroa, Aitor
    Agirre, Eneko
    EXPERT SYSTEMS WITH APPLICATIONS, 2023, 212
  • [49] Knowledge-based Question Answering by Jointly Generating, Copying and Paraphrasing
    Zhu, Shuguang
    Cheng, Xiang
    Su, Sen
    Lang, Shuang
    CIKM'17: PROCEEDINGS OF THE 2017 ACM CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, 2017, : 2439 - 2442
  • [50] Explainable Knowledge-Based Learning for Online Medical Question Answering
    Cui, Menglin
    Li, Xiang
    Qin, Peng
    KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT, PT V, KSEM 2024, 2024, 14888 : 294 - 304