Graph Convolutional Network Semantic Enhancement Hashing for Self-supervised Cross-Modal Retrieval

被引:0
|
作者
Hu, Jinyu [1 ]
Li, Mingyong [1 ]
Zhang, Jiayan [1 ]
机构
[1] Chongqing Normal Univ, Sch Comp Technol & Informat Sci, Chongqing 401331, Peoples R China
关键词
Cross-modal hashing; Graph Convolutional Network (GCN); Multi-modal retrieval;
D O I
10.1007/978-3-031-44216-2_34
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Cross-modal hashing has gained widespread attention for its computational efficiency and reduced storage costs while achieving great success in cross-modal retrieval. However, the data information of different modalities is asymmetric, which means that we usually think of images as being much more informative than text. Currently, most previous methods have no obvious difference in feature extraction and hash function learning modules, and they do not address the semantic gap between different modalities. We propose Graph Convolutional Network Semantic Enhancement Hashing (GCSEH) approach. Specifically, We aim to let information-rich modalities further support information-poor modalities to bridge the semantic gap between different modalities. In addition, in order to more accurately capture the semantic affinity between modalities, in order to be able to discover high-level semantic information, we choose to use a self-supervised semantic network. Extensive experiments have proven that our GCSEH method can achieve excellent performance.
引用
收藏
页码:410 / 422
页数:13
相关论文
共 50 条
  • [1] Self-supervised incomplete cross-modal hashing retrieval
    Peng, Shouyong
    Yao, Tao
    Li, Ying
    Wang, Gang
    Wang, Lili
    Yan, Zhiming
    [J]. Expert Systems with Applications, 2025, 262
  • [2] Graph Convolutional Network Hashing for Cross-Modal Retrieval
    Xu, Ruiqing
    Li, Chao
    Yan, Junchi
    Deng, Cheng
    Liu, Xianglong
    [J]. PROCEEDINGS OF THE TWENTY-EIGHTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2019, : 982 - 988
  • [3] Self-Supervised Adversarial Hashing Networks for Cross-Modal Retrieval
    Li, Chao
    Deng, Cheng
    Li, Ning
    Liu, Wei
    Gao, Xinbo
    Tao, Dacheng
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 4242 - 4251
  • [4] Graph Convolutional Network Discrete Hashing for Cross-Modal Retrieval
    Bai, Cong
    Zeng, Chao
    Ma, Qing
    Zhang, Jinglin
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (04) : 4756 - 4767
  • [5] Self-Supervised Cluster-Contrast Distillation Hashing Network for Cross-Modal Retrieval
    Sun, Haoxuan
    Cao, Yudong
    Liu, Guangyuan
    [J]. IEEE ACCESS, 2023, 11 : 96584 - 96593
  • [6] Autoencoder-based self-supervised hashing for cross-modal retrieval
    Li, Yifan
    Wang, Xuan
    Cui, Lei
    Zhang, Jiajia
    Huang, Chengkai
    Luo, Xuan
    Qi, Shuhan
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2021, 80 (11) : 17257 - 17274
  • [7] Autoencoder-based self-supervised hashing for cross-modal retrieval
    Yifan Li
    Xuan Wang
    Lei Cui
    Jiajia Zhang
    Chengkai Huang
    Xuan Luo
    Shuhan Qi
    [J]. Multimedia Tools and Applications, 2021, 80 : 17257 - 17274
  • [8] SEMI-SUPERVISED GRAPH CONVOLUTIONAL HASHING NETWORK FOR LARGE-SCALE CROSS-MODAL RETRIEVAL
    Shen, Zhanjian
    Zhai, Deming
    Liu, Xianming
    Jiang, Junjun
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2020, : 2366 - 2370
  • [9] Self-supervised deep semantics-preserving Hashing for cross-modal retrieval
    Lu B.
    Duan X.
    Yuan Y.
    [J]. Qinghua Daxue Xuebao/Journal of Tsinghua University, 2022, 62 (09): : 1442 - 1449
  • [10] Self-Supervised Multi-Modal Knowledge Graph Contrastive Hashing for Cross-Modal Search
    Liang, Meiyu
    Du, Junping
    Liang, Zhengyang
    Xing, Yongwang
    Huang, Wei
    Xue, Zhe
    [J]. THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 12, 2024, : 13744 - 13753