Learning discriminative hashing codes for cross-modal retrieval based on multi-view features

被引:2
|
作者
Yu, Jun [1 ]
Wu, Xiao-Jun [1 ]
Kittler, Josef [2 ]
机构
[1] Jiangnan Univ, Sch Internet Things Engn, Wuxi 214122, Jiangsu, Peoples R China
[2] Univ Surrey, Ctr Vis Speech & Signal Proc, Guildford GU2 7XH, Surrey, England
基金
英国工程与自然科学研究理事会; 中国国家自然科学基金;
关键词
Cross-modal retrieval; Hashing learning; Subspace learning; Kernelization; Multi-view features;
D O I
10.1007/s10044-020-00870-z
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Hashing techniques have been applied broadly in retrieval tasks due to their low storage requirements and high speed of processing. Many hashing methods based on a single view have been extensively studied for information retrieval. However, the representation capacity of a single view is insufficient and some discriminative information is not captured, which results in limited improvement. In this paper, we employ multiple views to represent images and texts for enriching the feature information. Our framework exploits the complementary information among multiple views to better learn the discriminative compact hash codes. A discrete hashing learning framework that jointly performs classifier learning and subspace learning is proposed to complete multiple search tasks simultaneously. Our framework includes two stages, namely a kernelization process and a quantization process. Kernelization aims to find a common subspace where multi-view features can be fused. The quantization stage is designed to learn discriminative unified hashing codes. Extensive experiments are performed on single-label datasets (WiKi and MMED) and multi-label datasets (MIRFlickr and NUS-WIDE), and the experimental results indicate the superiority of our method compared with the state-of-the-art methods.
引用
收藏
页码:1421 / 1438
页数:18
相关论文
共 50 条
  • [41] Discriminative latent semantics-preserving similarity embedding hashing for cross-modal retrieval
    Chen Y.
    Tan J.
    Yang Z.
    Cheng Y.
    Chen R.
    Neural Computing and Applications, 2024, 36 (18) : 10655 - 10680
  • [42] Deep Cross-Modal Hashing With Hashing Functions and Unified Hash Codes Jointly Learning
    Tu, Rong-Cheng
    Mao, Xian-Ling
    Ma, Bing
    Hu, Yong
    Yan, Tan
    Wei, Wei
    Huang, Heyan
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2022, 34 (02) : 560 - 572
  • [43] Discriminative Supervised Hashing for Cross-Modal Similarity Search
    Yu, Jun
    Wu, Xiao-Jun
    Kittler, Josef
    IMAGE AND VISION COMPUTING, 2019, 89 : 50 - 56
  • [44] Discriminative Cross-Modal Hashing with Coupled Semantic Correlation
    Yan S.-Y.
    Liu C.-H.
    Jiang A.-W.
    Ye J.-H.
    Wang M.-W.
    Jisuanji Xuebao/Chinese Journal of Computers, 2019, 42 (01): : 164 - 175
  • [45] Fast Unmediated Hashing for Cross-Modal Retrieval
    Nie, Xiushan
    Liu, Xingbo
    Xi, Xiaoming
    Li, Chenglong
    Yin, Yilong
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2021, 31 (09) : 3669 - 3678
  • [46] Cross-Modal Hashing Retrieval Based on Deep Residual Network
    Li, Zhiyi
    Xu, Xiaomian
    Zhang, Du
    Zhang, Peng
    COMPUTER SYSTEMS SCIENCE AND ENGINEERING, 2021, 36 (02): : 383 - 405
  • [47] Random Online Hashing for Cross-Modal Retrieval
    Jiang, Kaihang
    Wong, Wai Keung
    Fang, Xiaozhao
    Li, Jiaxing
    Qin, Jianyang
    Xie, Shengli
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, : 1 - 15
  • [48] Hierarchical Consensus Hashing for Cross-Modal Retrieval
    Sun, Yuan
    Ren, Zhenwen
    Hu, Peng
    Peng, Dezhong
    Wang, Xu
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 824 - 836
  • [49] Semantic consistency hashing for cross-modal retrieval
    Yao, Tao
    Kong, Xiangwei
    Fu, Haiyan
    Tian, Qi
    NEUROCOMPUTING, 2016, 193 : 250 - 259
  • [50] CROSS-MODAL RETRIEVAL BASED ON OPTIMIZED MATRIX FACTORIZATION HASHING
    Wu, Wei
    Jing, Xiaoyuan
    Du, Wencai
    Cao, Xinghui
    Zhou, Hui
    JOURNAL OF NONLINEAR AND CONVEX ANALYSIS, 2019, 20 (06) : 1173 - 1181