Learning discriminative hashing codes for cross-modal retrieval based on multi-view features

被引:2
|
作者
Yu, Jun [1 ]
Wu, Xiao-Jun [1 ]
Kittler, Josef [2 ]
机构
[1] Jiangnan Univ, Sch Internet Things Engn, Wuxi 214122, Jiangsu, Peoples R China
[2] Univ Surrey, Ctr Vis Speech & Signal Proc, Guildford GU2 7XH, Surrey, England
基金
英国工程与自然科学研究理事会; 中国国家自然科学基金;
关键词
Cross-modal retrieval; Hashing learning; Subspace learning; Kernelization; Multi-view features;
D O I
10.1007/s10044-020-00870-z
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Hashing techniques have been applied broadly in retrieval tasks due to their low storage requirements and high speed of processing. Many hashing methods based on a single view have been extensively studied for information retrieval. However, the representation capacity of a single view is insufficient and some discriminative information is not captured, which results in limited improvement. In this paper, we employ multiple views to represent images and texts for enriching the feature information. Our framework exploits the complementary information among multiple views to better learn the discriminative compact hash codes. A discrete hashing learning framework that jointly performs classifier learning and subspace learning is proposed to complete multiple search tasks simultaneously. Our framework includes two stages, namely a kernelization process and a quantization process. Kernelization aims to find a common subspace where multi-view features can be fused. The quantization stage is designed to learn discriminative unified hashing codes. Extensive experiments are performed on single-label datasets (WiKi and MMED) and multi-label datasets (MIRFlickr and NUS-WIDE), and the experimental results indicate the superiority of our method compared with the state-of-the-art methods.
引用
收藏
页码:1421 / 1438
页数:18
相关论文
共 50 条
  • [1] Learning discriminative hashing codes for cross-modal retrieval based on multi-view features
    Jun Yu
    Xiao-Jun Wu
    Josef Kittler
    Pattern Analysis and Applications, 2020, 23 : 1421 - 1438
  • [2] ROBUST MULTI-VIEW HASHING FOR CROSS-MODAL RETRIEVAL
    Wang, Haitao
    Chen, Hui
    Meng, Min
    Wu, JiGang
    2019 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2019, : 1012 - 1017
  • [3] Efficient Discriminative Hashing for Cross-Modal Retrieval
    Huang, Junfan
    Kang, Peipei
    Fang, Xiaozhao
    Han, Na
    Xie, Shengli
    Gao, Hongbo
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2024, 54 (06): : 3865 - 3878
  • [4] Multi-view collective tensor decomposition for cross-modal hashing
    Limeng Cui
    Jiawei Zhang
    Lifang He
    Philip S. Yu
    International Journal of Multimedia Information Retrieval, 2019, 8 : 47 - 59
  • [5] Multi-view Collective Tensor Decomposition for Cross-modal Hashing
    Cui, Limeng
    Chen, Zhensong
    Zhang, Jiawei
    He, Lifang
    Shi, Yong
    Yu, Philip S.
    ICMR '18: PROCEEDINGS OF THE 2018 ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA RETRIEVAL, 2018, : 73 - 81
  • [6] Multi-view collective tensor decomposition for cross-modal hashing
    Cui, Limeng
    Zhang, Jiawei
    He, Lifang
    Yu, Philip S.
    INTERNATIONAL JOURNAL OF MULTIMEDIA INFORMATION RETRIEVAL, 2019, 8 (01) : 47 - 59
  • [7] MULTI-VIEW FUSION THROUGH CROSS-MODAL RETRIEVAL
    Cui, Limeng
    Chen, Zhensong
    Zhang, Jiawei
    He, Lifang
    Shi, Yong
    Yu, Philip S.
    2018 25TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2018, : 1977 - 1981
  • [8] Discriminative correlation hashing for supervised cross-modal retrieval
    Lu, Xu
    Zhang, Huaxiang
    Sun, Jiande
    Wang, Zhenhua
    Guo, Peilian
    Wan, Wenbo
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2018, 65 : 221 - 230
  • [9] MVItem: A Benchmark for Multi-View Cross-Modal Item Retrieval
    Li, Bo
    Zhu, Jiansheng
    Dai, Linlin
    Jing, Hui
    Huang, Zhizheng
    Sui, Yuteng
    IEEE ACCESS, 2024, 12 : 119563 - 119576
  • [10] Discriminative deep asymmetric supervised hashing for cross-modal retrieval
    Qiang, Haopeng
    Wan, Yuan
    Liu, Ziyi
    Xiang, Lun
    Meng, Xiaojing
    Knowledge-Based Systems, 2022, 204