Random Online Hashing for Cross-Modal Retrieval

被引:1
|
作者
Jiang, Kaihang [1 ,2 ]
Wong, Wai Keung [1 ,2 ]
Fang, Xiaozhao [3 ,4 ]
Li, Jiaxing [5 ,6 ]
Qin, Jianyang [7 ]
Xie, Shengli [3 ,8 ]
机构
[1] Hong Kong Polytech Univ, Sch Fash & Text, Hong Kong, Peoples R China
[2] Lab Artificial Intelligence Design, Hong Kong, Peoples R China
[3] Guangdong Univ Technol, Sch Automat, Guangzhou 510006, Peoples R China
[4] Minist Educ, Key Lab Intelligent Detect & Internet Things Mfg, Guangzhou 510006, Peoples R China
[5] Guangzhou Univ, Inst Artificial Intelligence, Guangzhou 510006, Peoples R China
[6] Hong Kong Polytech Univ, Sch Fash & Text, Lab Artificial Intelligence Design, Hong Kong, Peoples R China
[7] Harbin Inst Technol, Sch Comp Sci & Technol, Shenzhen 518055, Peoples R China
[8] Guangdong Univ Technol, Guangdong Hong Kong Macao Joint Lab Smart Discrete, Guangzhou 510006, Peoples R China
关键词
Bridging strategy; cross-modal retrieval; maximum eigenvalue direction (MED) embedding; online hashing;
D O I
10.1109/TNNLS.2023.3330975
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In the past decades, supervised cross-modal hashing methods have attracted considerable attentions due to their high searching efficiency on large-scale multimedia databases. Many of these methods leverage semantic correlations among heterogeneous modalities by constructing a similarity matrix or building a common semantic space with the collective matrix factorization method. However, the similarity matrix may sacrifice the scalability and cannot preserve more semantic information into hash codes in the existing methods. Meanwhile, the matrix factorization methods cannot embed the main modality-specific information into hash codes. To address these issues, we propose a novel supervised cross-modal hashing method called random online hashing (ROH) in this article. ROH proposes a linear bridging strategy to simplify the pair-wise similarities factorization problem into a linear optimization one. Specifically, a bridging matrix is introduced to establish a bidirectional linear relation between hash codes and labels, which preserves more semantic similarities into hash codes and significantly reduces the semantic distances between hash codes of samples with similar labels. Additionally, a novel maximum eigenvalue direction (MED) embedding method is proposed to identify the direction of maximum eigenvalue for the original features and preserve critical information into modality-specific hash codes. Eventually, to handle real-time data dynamically, an online structure is adopted to solve the problem of dealing with new arrival data chunks without considering pairwise constraints. Extensive experimental results on three benchmark datasets demonstrate that the proposed ROH outperforms several state-of-the-art cross-modal hashing methods.
引用
收藏
页码:1 / 15
页数:15
相关论文
共 50 条
  • [1] Supervised Hierarchical Online Hashing for Cross-modal Retrieval
    Han, Kai
    Liu, Yu
    Wei, Rukai
    Zhou, Ke
    Xu, Jinhui
    Long, Kun
    [J]. ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2024, 20 (04)
  • [2] Online Cross-Modal Hashing for Web Image Retrieval
    Xie, Liang
    Shen, Jialie
    Zhu, Lei
    [J]. THIRTIETH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2016, : 294 - 300
  • [3] Label Embedding Online Hashing for Cross-Modal Retrieval
    Wang, Yongxin
    Luo, Xin
    Xu, Xin-Shun
    [J]. MM '20: PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, 2020, : 871 - 879
  • [4] Online hashing with partially known labels for cross-modal retrieval
    Shu, Zhenqiu
    Li, Li
    Yu, Zhengtao
    [J]. Engineering Applications of Artificial Intelligence, 2024, 138
  • [5] ONION: Online Semantic Autoencoder Hashing for Cross-Modal Retrieval
    Zhang, Donglin
    Wu, Xiao-Jun
    Chen, Guoqing
    [J]. ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2023, 14 (02)
  • [6] Online deep hashing for both uni-modal and cross-modal retrieval
    Xie, Yicai
    Zeng, Xianhua
    Wang, Tinghua
    Yi, Yun
    [J]. Information Sciences, 2022, 608 : 1480 - 1502
  • [7] Online deep hashing for both uni-modal and cross-modal retrieval
    Xie, Yicai
    Zeng, Xianhua
    Wang, Tinghua
    Yi, Yun
    [J]. INFORMATION SCIENCES, 2022, 608 : 1480 - 1502
  • [8] Hashing for Cross-Modal Similarity Retrieval
    Liu, Yao
    Yuan, Yanhong
    Huang, Qiaoli
    Huang, Zhixing
    [J]. 2015 11TH INTERNATIONAL CONFERENCE ON SEMANTICS, KNOWLEDGE AND GRIDS (SKG), 2015, : 1 - 8
  • [9] Online supervised collective matrix factorization hashing for cross-modal retrieval
    Shu, Zhenqiu
    Li, Li
    Yu, Jun
    Zhang, Donglin
    Yu, Zhengtao
    Wu, Xiao-Jun
    [J]. APPLIED INTELLIGENCE, 2023, 53 (11) : 14201 - 14218
  • [10] Online supervised collective matrix factorization hashing for cross-modal retrieval
    Zhenqiu Shu
    Li Li
    Jun Yu
    Donglin Zhang
    Zhengtao Yu
    Xiao-Jun Wu
    [J]. Applied Intelligence, 2023, 53 : 14201 - 14218