Cross-media retrieval of scientific and technological information based on multi-feature fusion

被引:0
|
作者
Jiang, Yang [1 ]
Du, Junping [1 ]
Xue, Zhe [1 ]
Li, Ang [1 ]
机构
[1] Beijing Univ Posts & Telecommun Beijing, Sch Comp Sci, Beijing Key Lab Intelligent Telecommun Software &, Beijing 100876, Peoples R China
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
Cross -media retrieval; Adversarial learning; Neural network;
D O I
10.1016/j.neucom.2022.06.061
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In the era of big data, People's lives are filled with all kinds of information. Scientific and technological information is utilized for scholars to understand the current technology trends, and to think about the source of information for future development prospects. More and more scholars are no longer sat-isfied with single-modal retrieval methods. However, to get more intelligent cross-media retrieval results we should give higher requirements to the search engine. And how to span the semantic gap between different modalities is a key issue that needs to be solved. In response to the above problems, this paper proposes a Multi-feature Fusion based Cross-Media Retrieval (MFCMR) method. Our method is capable of integrating multiple features to promote semantic understanding, and adopting adversarial learning to further improve the accuracy of public subspace representation. Then we use similarity in the same space to sort the retrieval results. We conduct a lot of experiments on real datasets, and the results show that our method obtains better cross-media retrieval performance than other methods.(c) 2022 Published by Elsevier B.V.
引用
收藏
页码:85 / 93
页数:9
相关论文
共 50 条
  • [11] An Adaptive Weight Method for Image Retrieval Based Multi-Feature Fusion
    Lu, Xiaojun
    Wang, Jiaojuan
    Li, Xiang
    Yang, Mei
    Zhang, Xiangde
    ENTROPY, 2018, 20 (08)
  • [12] Cross-Media Information Retrieval Based on Cycle Generative Adversarial Networks
    Nie W.-Z.
    Wang Y.
    Yang S.
    Liu A.-A.
    Zhang Y.-D.
    Jisuanji Xuebao/Chinese Journal of Computers, 2022, 45 (07): : 1529 - 1538
  • [13] Complementary information retrieval for cross-media news content
    Ma, Qiang
    Nadamoto, Akiyo
    Tanaka, Katsumi
    INFORMATION SYSTEMS, 2006, 31 (07) : 659 - 678
  • [14] Fashion recommendations through cross-media information retrieval
    Zhou, Wei
    Mok, P. Y.
    Zhou, Yanghong
    Zhou, Yangping
    Shen, Jialie
    Qu, Qiang
    Chau, K. P.
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2019, 61 : 112 - 120
  • [15] A Novel Emergency Cross-Media Information Retrieval Model
    Zi, Lingling
    Du, Junping
    Wang, Qian
    Lee, Jangmyung
    PROCEEDINGS OF 2013 CHINESE INTELLIGENT AUTOMATION CONFERENCE: INTELLIGENT INFORMATION PROCESSING, 2013, 256 : 387 - 394
  • [16] COUPLED FEATURE MAPPING AND CORRELATION MINING FOR CROSS-MEDIA RETRIEVAL
    Fan, Mengdi
    Wang, Wenmin
    Wang, Ronggang
    2016 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA & EXPO WORKSHOPS (ICMEW), 2016,
  • [17] Accurate Retrieval of Multi-scale Clothing Images Based on Multi-feature Fusion
    Wang Z.-W.
    Pu Y.-Y.
    Wang X.
    Zhao Z.-P.
    Xu D.
    Qian W.-H.
    Jisuanji Xuebao/Chinese Journal of Computers, 2020, 43 (04): : 740 - 754
  • [18] Cross-media retrieval based on CSRN clustering
    Zeng, Cheng
    Wang, Zhenzhen
    Du, Gang
    Journal of Computational Information Systems, 2010, 6 (09): : 2821 - 2830
  • [19] Fast Image Retrieval of Textile Industrial Accessory Based on Multi-Feature Fusion
    沈文忠
    杨杰
    Journal of Donghua University(English Edition), 2004, (03) : 117 - 122
  • [20] Multi-feature Fusion Based Retrieval Results Optimization for Crime Scene Investigation Image Retrieval
    Liu Y.
    Hu D.
    Fan J.-L.
    Wang F.-P.
    Li D.-X.
    Tien Tzu Hsueh Pao/Acta Electronica Sinica, 2019, 47 (02): : 296 - 301