Twofold Structured Features-Based Siamese Network for Infrared Target Tracking

被引:0
|
作者
Yan, Weijie [1 ,2 ]
Gu, Guohua [1 ,2 ]
Xu, Yunkai [1 ,2 ]
Kong, Xiaofang [3 ]
Shao, Ajun [1 ,2 ]
Chen, Qian [1 ,2 ]
Wan, Minjie [1 ,2 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Elect & Opt Engn, Nanjing 210094, Peoples R China
[2] Nanjing Univ Sci & Technol, Jiangsu Key Lab Spectral Imaging & Intelligent Sen, Nanjing 210094, Peoples R China
[3] Nanjing Univ Sci & Technol, Natl Key Lab Transient Phys, Nanjing 210094, Peoples R China
基金
中国国家自然科学基金;
关键词
Target tracking; Feature extraction; Semantics; Transformers; Deep learning; Data mining; Training; Deep semantic features; infrared target tracking; multitemplate update; shallow spatial features; Siamese network; twofold structured features; ONLINE OBJECT TRACKING;
D O I
10.1109/TCSS.2024.3391631
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Nowadays, infrared target tracking has been a critical technology in the field of computer vision and has many computational social system-related applications, such as urban security, pedestrian counting, smoke and fire detection, and so forth. Unfortunately, due to the absence of detailed information such as texture or color, it is easy for tracking drift to occur when the tracker encounters infrared targets that vary in shape or size. In order to address this issue, we present a twofold structured features-based Siamese network for infrared target tracking. Above all, a novel feature fusion network is proposed to make full use of both shallow spatial information and deep semantic information in a comprehensive manner, so as to improve the discriminative capacity for infrared targets. Then, a multitemplate update module is designed to effectively deal with interferences from target appearance changes which are prone to cause early tracking failures. Finally, both qualitative and quantitative experiments are implemented on VOT-TIR 2016 and GTOT datasets, which demonstrates that our method achieves the balance of promising tracking performance and real-time tracking speed against other state-of-the-art trackers.
引用
收藏
页数:16
相关论文
共 50 条
  • [1] Aerial infrared target tracking based on a Siamese network and traditional features
    Hu, Yangguang
    Xiao, Mingqing
    Li, Shaoyi
    Yang, Yao
    [J]. INFRARED PHYSICS & TECHNOLOGY, 2020, 111
  • [2] Hierarchical Attention Siamese Network for Thermal Infrared Target Tracking
    Yuan, Di
    Liao, Donghai
    Huang, Feng
    Qiu, Zhaobing
    Shu, Xiu
    Tian, Chunwei
    Liu, Qiao
    [J]. IEEE Transactions on Instrumentation and Measurement, 2024, 73
  • [3] Hierarchical Convolution Fusion-Based Adaptive Siamese Network for Infrared Target Tracking
    Xu, Yunkai
    Wan, Minjie
    Chen, Qian
    Qian, Weixian
    Ren, Kan
    Gu, Guohua
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2021, 70
  • [4] The invariant features-based target tracking across multiple cameras
    Jin Xiao
    Zhou Liu
    Heng Yang
    Xiaoguang Hu
    [J]. Multimedia Tools and Applications, 2017, 76 : 12165 - 12179
  • [5] The invariant features-based target tracking across multiple cameras
    Xiao, Jin
    Liu, Zhou
    Yang, Heng
    Hu, Xiaoguang
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2017, 76 (10) : 12165 - 12179
  • [6] Target tracking based on deformable convolution siamese network
    Liu R.-H.
    Zhang J.-X.
    Jin C.-X.
    Lu X.-L.
    [J]. Kongzhi yu Juece/Control and Decision, 2022, 37 (08): : 2049 - 2055
  • [7] A Twofold Siamese Network for Real-Time Object Tracking
    He, Anfeng
    Luo, Chong
    Tian, Xinmei
    Zeng, Wenjun
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 4834 - 4843
  • [8] Scale and appearance variation enhanced siamese network for thermal infrared target tracking
    Yao, Tingting
    Hu, Jincheng
    Zhang, Bo
    Gao, Yuan
    Li, Pengfei
    Hu, Qing
    [J]. INFRARED PHYSICS & TECHNOLOGY, 2021, 117
  • [9] Adaptive Siamese network based UAV target tracking algorithm
    Liu F.
    Yang A.
    Wu Z.
    [J]. Yang, Anzhe (anzheyang@emails.bjut.edu.cn), 1600, Chinese Society of Astronautics (41):
  • [10] Research on Target Tracking Algorithm Based on Siamese Neural Network
    Pang, Haibo
    Xuan, Qi
    Xie, Meiqin
    Liu, Chengming
    Li, Zhanbo
    [J]. MOBILE INFORMATION SYSTEMS, 2021, 2021