SCH: Symmetric Consistent Hashing for cross-modal retrieval

被引:0
|
作者
Ni, Haomin [1 ]
Fang, Xiaozhao [1 ,4 ,5 ]
Kang, Peipei [2 ]
Gao, Hongbo [3 ]
Zhou, Guoxu [1 ]
Xie, Shengli [1 ]
机构
[1] Guangdong Univ Technol, Sch Automat, 100 Waihuan Xi Rd, Guangzhou 510000, Guangdong, Peoples R China
[2] Guangdong Univ Technol, Sch Comp Sci & Technol, 100 Waihuan Xi Rd, Guangzhou 510000, Guangdong, Peoples R China
[3] Univ Sci & Technol China, Sch Informat Sci, Dept Automat, 96 Jinzhai Rd, Hefei 230026, Anhui, Peoples R China
[4] Guangdong Univ Technol, Guangdong Prov Key Lab Minimally Invas Surg Instru, 100 Waihuan Xi Rd, Guangzhou 510000, Guangdong, Peoples R China
[5] Peng Cheng Lab, Dept Math & Theories, Shenzhen 518000, Guangdong, Peoples R China
来源
SIGNAL PROCESSING | 2024年 / 215卷
基金
中国国家自然科学基金; 美国国家科学基金会;
关键词
Hashing method; Discrete optimization; Residual preservation; Cross-modal retrieval;
D O I
10.1016/j.sigpro.2023.109255
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
When handling large-scale multimodal data, hashing-based retrieval methods have gained significant attention due to their advantages in terms of low storage consumption and quick query speed. Despite the good performance of supervised hashing techniques, there are still certain limitations that need to be addressed. Firstly, they ignore valuable information such as reconstruction residuals when employing matrix factorization to learn the low-dimensional space. Secondly, most methods map heterogeneous data to the same feature space, which is unreasonable because different modalities possess distinct dimensions and distributions. Lastly, some methods relax constraints in order to optimize discrete hash codes, leading to considerable quantization errors. To solve the above problems, a novel two-step hashing-based technology called Symmetric Consistent Hashing (SCH) is proposed. Specifically, in the first step, two separate latent semantic spaces are learned by leveraging Principal Component Analysis to mitigate principal energy loss and Locality Preserving Projections to preserve local similarity. Then, the latent spaces of different modalities are aligned to facilitate the sharing of highlevel semantic information by exploiting modality consistency. Next, hash codes are learned from distinct latent spaces, which are embedded in the second step for learning hash functions through Kernel Logistic Regression. To validate the effectiveness of SCH, extensive experiments on three publicly available benchmark datasets are accomplished. The results demonstrate the superiority of SCH over state-of-the-art hashing baselines, thus confirming the potency of the proposed approach.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] Asymmetric Supervised Consistent and Specific Hashing for Cross-Modal Retrieval
    Meng, Min
    Wang, Haitao
    Yu, Jun
    Chen, Hui
    Wu, Jigang
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 986 - 1000
  • [2] Cycle-Consistent Deep Generative Hashing for Cross-Modal Retrieval
    Wu, Lin
    Wang, Yang
    Shao, Ling
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (04) : 1602 - 1612
  • [3] LABEL CONSISTENT MATRIX FACTORIZATION BASED HASHING FOR CROSS-MODAL RETRIEVAL
    Mandal, Devraj
    Biswas, Soma
    [J]. 2017 24TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2017, : 2901 - 2905
  • [4] OLCH: Online Label Consistent Hashing for streaming cross-modal retrieval
    Peng, Shu-Juan
    Yi, Jinhan
    Liu, Xin
    Cheung, Yiu-ming
    Cui, Zhen
    Li, Taihao
    [J]. PATTERN RECOGNITION, 2024, 150
  • [5] Hashing for Cross-Modal Similarity Retrieval
    Liu, Yao
    Yuan, Yanhong
    Huang, Qiaoli
    Huang, Zhixing
    [J]. 2015 11TH INTERNATIONAL CONFERENCE ON SEMANTICS, KNOWLEDGE AND GRIDS (SKG), 2015, : 1 - 8
  • [6] Label Consistent Flexible Matrix Factorization Hashing for Efficient Cross-modal Retrieval
    Zhang, Donglin
    Wu, Xiao-Jun
    Yu, Jun
    [J]. ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2021, 17 (03)
  • [7] Semantic-Consistent and Multilayer Similarity Based Cross-Modal Hashing Retrieval
    Liu, Yuanyuan
    Wang, Xiaoyan
    Zhang, Yuxin
    Zhu, Lu
    [J]. Data Analysis and Knowledge Discovery, 2024, 8 (07) : 89 - 102
  • [8] Fast Unmediated Hashing for Cross-Modal Retrieval
    Nie, Xiushan
    Liu, Xingbo
    Xi, Xiaoming
    Li, Chenglong
    Yin, Yilong
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2021, 31 (09) : 3669 - 3678
  • [9] Hierarchical Consensus Hashing for Cross-Modal Retrieval
    Sun, Yuan
    Ren, Zhenwen
    Hu, Peng
    Peng, Dezhong
    Wang, Xu
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 824 - 836
  • [10] Random Online Hashing for Cross-Modal Retrieval
    Jiang, Kaihang
    Wong, Wai Keung
    Fang, Xiaozhao
    Li, Jiaxing
    Qin, Jianyang
    Xie, Shengli
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, : 1 - 15