Attention-based deep supervised hashing for near duplicate video retrieval

被引:1
|
作者
Shi, Naifei [1 ]
Fu, Chong [1 ,2 ,3 ]
Tie, Ming [4 ]
Zhang, Wenchao [1 ]
Wang, Xingwei [1 ]
Sham, Chiu-Wing [5 ]
机构
[1] Northeastern Univ, Sch Comp Sci & Engn, Shenyang 110819, Peoples R China
[2] Northeastern Univ, Minist Educ, Engn Res Ctr Secur Technol Complex Network Syst, Shenyang 110819, Peoples R China
[3] Northeastern Univ, Key Lab Intelligent Comp Med Image, Minist Educ, Shenyang 110819, Peoples R China
[4] Sci & Technol Space Phys Lab, Beijing 100076, Peoples R China
[5] Univ Auckland, Sch Comp Sci, Auckland, New Zealand
来源
NEURAL COMPUTING & APPLICATIONS | 2023年 / 36卷 / 10期
基金
中国国家自然科学基金;
关键词
Near duplicate video retrieval; Deep video hashing; Spatio-temporal attention; Pairwise supervised learning;
D O I
10.1007/s00521-023-09342-x
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
With the explosive growth of video data on the Internet, near duplicate video retrieval (NDVR) has become an important and challenging issue in the field of information retrieval. Hashing is typically employed to tackle this issue owing to its low memory and fast retrieval speed. Most of the existing video hashing methods directly adopt image hashing methods or perform the frame-pooling strategy, failing to fully explore the spatio-temporal information of videos. In this paper, we propose an attention-based deep supervised video hashing (ADVH) network for NDVR. To capture richer perceptions and acquire more comprehensive video representations, we use a residual network as the backbone and incorporate an attention module to extract spatio-temporal features of videos and motion information between adjacent frames. Moreover, we design a novel pairwise constraint utilizing supervised information to learn compact and discriminative video hash codes. The experimental results on three benchmark video datasets demonstrate that our proposed model outperforms other state-of-the-art hashing methods in retrieval precision.
引用
收藏
页码:5217 / 5230
页数:14
相关论文
共 50 条
  • [1] Attention-based deep supervised hashing for near duplicate video retrieval
    Naifei Shi
    Chong Fu
    Ming Tie
    Wenchao Zhang
    Xingwei Wang
    Chiu-Wing Sham
    [J]. Neural Computing and Applications, 2024, 36 : 5217 - 5230
  • [2] Attention-Based Deep Metric Learning for Near-Duplicate Video Retrieval
    Wang, Kuan-Hsun
    Cheng, Chia-Chun
    Chen, Yi-Ling
    Song, Yale
    Lai, Shang-Hong
    [J]. 2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 5360 - 5367
  • [3] Attention-Based Video Hashing for Large-Scale Video Retrieval
    Wang, Yingxin
    Nie, Xiushan
    Shi, Yang
    Zhou, Xin
    Yin, Yilong
    [J]. IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS, 2021, 13 (03) : 491 - 502
  • [4] Attention-based Saliency Hashing for Ophthalmic Image Retrieval
    Fang, Jiansheng
    Xu, Yanwu
    Zhang, Xiaoqing
    Hu, Yan
    Liu, Jiang
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOMEDICINE, 2020, : 990 - 995
  • [5] Near-Duplicate Video Retrieval with Deep Metric Learning
    Kordopatis-Zilos, Giorgos
    Papadopoulos, Symeon
    Patras, Ioannis
    Kompatsiaris, Yiannis
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2017), 2017, : 347 - 356
  • [6] Stochastic Multiview Hashing for Large-Scale Near-Duplicate Video Retrieval
    Hao, Yanbin
    Mu, Tingting
    Hong, Richang
    Wang, Meng
    An, Ning
    Goulermas, John Y.
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2017, 19 (01) : 1 - 14
  • [7] WEAKLY SUPERVISED LOCALITY SENSITIVE HASHING FOR DUPLICATE IMAGE RETRIEVAL
    Cao, Yudong
    Zhang, Honggang
    Guo, Jun
    [J]. 2011 18TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2011,
  • [8] Bit-wise attention deep complementary supervised hashing for image retrieval
    Wing W. Y. Ng
    Jiayong Li
    Xing Tian
    Hui Wang
    [J]. Multimedia Tools and Applications, 2022, 81 : 927 - 951
  • [9] Bit-wise attention deep complementary supervised hashing for image retrieval
    Ng, Wing W. Y.
    Li, Jiayong
    Tian, Xing
    Wang, Hui
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (01) : 927 - 951
  • [10] Discriminative Codebook Hashing for Supervised Video Retrieval
    Bian, Xiaoman
    Lan, Rushi
    Wang, Xiaoqin
    Chen, Chen
    Liu, Zhenbing
    Luo, Xiaonan
    Lai, Kuei-Kuei
    [J]. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2021, 2021