A Novel Semantics-Preserving Hashing for Fine-Grained Image Retrieval

被引:9
|
作者
Sun, Han [1 ,3 ]
Fan, Yejia [1 ,3 ]
Shen, Jiaquan [1 ,3 ]
Liu, Ningzhong [1 ,3 ]
Liang, Dong [2 ,3 ]
Zhou, Huiyu [4 ]
机构
[1] Nanjing Univ Aeronaut & Astronaut, Coll Comp Sci & Technol, Nanjing 211106, Jiangsu, Peoples R China
[2] Nanjing Univ Aeronaut & Astronaut, Coll Comp Sci & Technol, Pattern Recognit & Neural Comp Lab, Nanjing 211106, Jiangsu, Peoples R China
[3] MIIT Key Lab Pattern Anal & Machine Intelligence, Nanjing 211106, Jiangsu, Peoples R China
[4] Univ Leicester, Dept Informat, Leicester LE1 7RH, Leics, England
来源
IEEE ACCESS | 2020年 / 8卷
关键词
Deep hashing; fine-grained images; feature switch layer; image retrieval; REPRESENTATION; ALGORITHMS;
D O I
10.1109/ACCESS.2020.2970223
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the advent of the era of big data, the storage and retrieval of data have become a research hotspot. Hashing methods that transform high-dimensional data into compact binary codes have received increasing attention. Recently, with the successful application of convolutional neural networks in computer vision, deep hashing methods utilize an end-to-end framework to learn feature representations and hash codes mutually, which achieve better retrieval performance than conventional hashing methods. However, deep hashing methods still face some challenges in image retrieval. Firstly, most existing deep hashing methods preserve similarity between original data space and hash coding space using loss functions with high time complexity, which cannot get a win-win situation in time and accuracy. Secondly, few existing deep hashing methods are designed for fine-grained image retrieval, which is necessary in practice. In this study, we propose a novel semantics-preserving hashing method which solves the above problems. We add a hash layer before the classification layer as a feature switch layer to guide the classification. At the same time, we replace the complicated loss with the simple classification loss, combining with quantization loss and bit balance loss to generate high-quality hash codes. Besides, we incorporate feature extractor designed for fine-grained image classification into our network for better representation learning. The results on three widely-used fine-grained image datasets show that our method is superior to other state-of-the-art image retrieval methods.
引用
收藏
页码:26199 / 26209
页数:11
相关论文
共 50 条
  • [1] Deep Semantics-Preserving Hashing Based Skin Lesion Image Retrieval
    Pu, Xiaorong
    Li, Yan
    Qiu, Hang
    Sun, Yinhui
    [J]. ADVANCES IN NEURAL NETWORKS, PT II, 2017, 10262 : 282 - 289
  • [2] Semantics-Preserving Hashing for Cross-View Retrieval
    Lin, Zijia
    Ding, Guiguang
    Hu, Mingqing
    Wang, Jianmin
    [J]. 2015 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2015, : 3864 - 3872
  • [3] Unsupervised Deep Hashing With Fine-Grained Similarity-Preserving Contrastive Learning for Image Retrieval
    Cao, Hu
    Huang, Lei
    Nie, Jie
    Wei, Zhiqiang
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (05) : 4095 - 4108
  • [4] Attributes Grouping and Mining Hashing for Fine-Grained Image Retrieval
    Lu, Xin
    Chen, Shikun
    Cao, Yichao
    Zhou, Xin
    Lu, Xiaobo
    [J]. PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 6558 - 6566
  • [5] Discriminative feature mining hashing for fine-grained image retrieval
    Lang, Wenxi
    Sun, Han
    Xu, Can
    Liu, Ningzhong
    Zhou, Huiyu
    [J]. JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2022, 87
  • [6] Deep Listwise Triplet Hashing for Fine-Grained Image Retrieval
    Liang, Yuchen
    Pan, Yan
    Lai, Hanjiang
    Liu, Wei
    Yin, Jian
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 949 - 961
  • [7] Supervised deep semantics-preserving hashing for real-time pulmonary nodule image retrieval
    Qi, Yongjun
    Gu, Junhua
    Zhang, Yajuan
    Wu, Gengshen
    Wang, Feng
    [J]. JOURNAL OF REAL-TIME IMAGE PROCESSING, 2020, 17 (06) : 1857 - 1868
  • [8] Supervised deep semantics-preserving hashing for real-time pulmonary nodule image retrieval
    Yongjun Qi
    Junhua Gu
    Yajuan Zhang
    Gengshen Wu
    Feng Wang
    [J]. Journal of Real-Time Image Processing, 2020, 17 : 1857 - 1868
  • [9] Correlation Filtering-Based Hashing for Fine-Grained Image Retrieval
    Ma, Lei
    Li, Xuan
    Shi, Yu
    Wu, Jinmeng
    Zhang, Yaozhong
    [J]. IEEE SIGNAL PROCESSING LETTERS, 2020, 27 : 2129 - 2133
  • [10] Sub-Region Localized Hashing for Fine-Grained Image Retrieval
    Xiang, Xinguang
    Zhang, Yajie
    Jin, Lu
    Li, Zechao
    Tang, Jinhui
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 314 - 326