Cross-media retrieval of scientific and technological information based on multi-feature fusion

被引:0
|
作者
Jiang, Yang [1 ]
Du, Junping [1 ]
Xue, Zhe [1 ]
Li, Ang [1 ]
机构
[1] Beijing Univ Posts & Telecommun Beijing, Sch Comp Sci, Beijing Key Lab Intelligent Telecommun Software &, Beijing 100876, Peoples R China
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
Cross -media retrieval; Adversarial learning; Neural network;
D O I
10.1016/j.neucom.2022.06.061
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In the era of big data, People's lives are filled with all kinds of information. Scientific and technological information is utilized for scholars to understand the current technology trends, and to think about the source of information for future development prospects. More and more scholars are no longer sat-isfied with single-modal retrieval methods. However, to get more intelligent cross-media retrieval results we should give higher requirements to the search engine. And how to span the semantic gap between different modalities is a key issue that needs to be solved. In response to the above problems, this paper proposes a Multi-feature Fusion based Cross-Media Retrieval (MFCMR) method. Our method is capable of integrating multiple features to promote semantic understanding, and adopting adversarial learning to further improve the accuracy of public subspace representation. Then we use similarity in the same space to sort the retrieval results. We conduct a lot of experiments on real datasets, and the results show that our method obtains better cross-media retrieval performance than other methods.(c) 2022 Published by Elsevier B.V.
引用
收藏
页码:85 / 93
页数:9
相关论文
共 50 条
  • [31] Multi-feature Fusion for Crime Scene Investigation Image Retrieval
    Liu, Ying
    Hu, Dan
    Fan, Jiulun
    Wang, Fuping
    Zhang, Dengsheng
    2017 INTERNATIONAL CONFERENCE ON DIGITAL IMAGE COMPUTING - TECHNIQUES AND APPLICATIONS (DICTA), 2017, : 865 - 871
  • [32] COUPLED FEATURE SELECTION FOR MODALITY-DEPENDENT CROSS-MEDIA RETRIEVAL
    Yu, En
    Sun, Jiande
    Wang, Li
    Zhang, Huaxiang
    Li, Jing
    2017 INTERNATIONAL SYMPOSIUM ON INTELLIGENT SIGNAL PROCESSING AND COMMUNICATION SYSTEMS (ISPACS 2017), 2017, : 315 - 320
  • [33] LARGE-SCALE CROSS-MEDIA RETRIEVAL BY HETEROGENEOUS FEATURE AUGMENTATION
    Li, Qiang
    Han, Yahong
    Dang, Jianwu
    2014 12TH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING (ICSP), 2014, : 977 - 980
  • [34] Adaptive multi-feature fusion via cross-entropy normalization for effective image retrieval
    Ma, Wentao
    Zhou, Tongqing
    Qin, Jiaohua
    Xiang, Xuyu
    Tan, Yun
    Cai, Zhiping
    INFORMATION PROCESSING & MANAGEMENT, 2023, 60 (01)
  • [35] Robust music information retrieval on mobile network based on multi-feature clustering
    Yoon, Won-Jung
    Oh, Sanghun
    Park, Kyu-Sik
    ADVANCED DATA MINING AND APPLICATIONS, PROCEEDINGS, 2006, 4093 : 279 - 283
  • [36] Internet cross-media retrieval based on deep learning
    Jiang, Bin
    Yang, Jiachen
    Lv, Zhihan
    Tian, Kun
    Meng, Qinggang
    Yan, Yan
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2017, 48 : 356 - 366
  • [37] Classification of Rice Producing Area in Heilongjiang Province Based on Cross-Media Feature Fusion
    Hu, Wen
    Li, Ang
    2019 4TH INTERNATIONAL CONFERENCE ON COMMUNICATION, IMAGE AND SIGNAL PROCESSING (CCISP 2019), 2020, 1438
  • [38] Bagging-based cross-media retrieval algorithm
    Xu, Gongwen
    Zhang, Yu
    Yin, Mingshan
    Hong, Wenzhong
    Zou, Ran
    Wang, Shanshan
    SOFT COMPUTING, 2023, 27 (05) : 2615 - 2623
  • [39] Cross-media retrieval based on linear discriminant analysis
    Qi, Yudan
    Zhang, Huaxiang
    Zhang, Bin
    Wang, Li
    Zheng, Shunxin
    MULTIMEDIA TOOLS AND APPLICATIONS, 2019, 78 (17) : 24249 - 24268
  • [40] Cross-media retrieval based on synthesis reasoning model
    College of Computer Science and Technology, Zhejiang University, Hangzhou 310027, China
    Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao, 2009, 9 (1307-1314):