Siamese network with contrastive learning and adaptive template updating for object tracking

被引:0
|
作者
Cui, Wei [1 ,2 ]
Duan, Xun [1 ,2 ]
Kong, Guangqian [1 ,2 ]
Long, Huiyun [1 ,2 ]
机构
[1] Guizhou Univ, State Key Lab Publ Big Data, Guiyang, Peoples R China
[2] Guizhou Univ, Coll Comp Sci & Technol, Guiyang, Peoples R China
基金
中国国家自然科学基金;
关键词
contrastive learning; object tracking; Siamese network; average peak correlation energy; attention mechanism;
D O I
10.1117/1.JEI.33.1.013002
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Visual object tracking is a crucial task across numerous computer vision applications. However, object tracking algorithms face significant challenges stemming from deformation and fast motion, which frequently incur dramatic changes to the target's appearance. To address this problem, we propose a Siamese-network-based object tracking method that combines contrastive learning and adaptive template updating. First, we designed a contrastive branch based on a Siamese network, which constructs a contrastive network with a template branch. The objective of this network is to capture the invariance associated with different images of the same target. Subsequently, we implemented an adaptive template updating strategy for the timely capture of appearance changes in targets and adjusted the size and position of the bounding box. Finally, the alpha-complete intersection over union function was introduced to continuously optimize the generation of bounding boxes during training, guiding the model to produce more accurate tracking boxes and further improving the algorithm performance. The experimental results demonstrate that our algorithm achieves advanced performance on five datasets, namely GOT-10k, LaSOT, UAV123, OTB2015, and NFS.
引用
下载
收藏
页数:19
相关论文
共 50 条
  • [1] Adaptive Image Dehazing and Object Tracking in UAV Videos Based on the Template Updating Siamese Network
    Sun, Lifan
    Chang, Jiashun
    Zhang, Jinjin
    Fan, Bo
    He, Zishu
    IEEE SENSORS JOURNAL, 2023, 23 (11) : 12320 - 12333
  • [2] Learning adaptive updating siamese network for visual tracking
    Zhou, Yifei
    Li, Jing
    Du, Bo
    Chang, Jun
    Ding, Zhiquan
    Qin, Tianqi
    MULTIMEDIA TOOLS AND APPLICATIONS, 2021, 80 (19) : 29849 - 29873
  • [3] Learning adaptive updating siamese network for visual tracking
    Yifei Zhou
    Jing Li
    Bo Du
    Jun Chang
    Zhiquan Ding
    Tianqi Qin
    Multimedia Tools and Applications, 2021, 80 : 29849 - 29873
  • [4] Siamese Tracking with Adaptive Template-Updating Strategy
    Xu, Zheng
    Luo, Haibo
    Hui, Bin
    Chang, Zheng
    Ju, Moran
    APPLIED SCIENCES-BASEL, 2019, 9 (18):
  • [5] Template Attentional Siamese Network for Object Tracking
    Gao, Junyan
    Yang, Zhenguo
    Liu, Wenyin
    PROCEEDINGS OF 2018 THE 2ND INTERNATIONAL CONFERENCE ON VIDEO AND IMAGE PROCESSING (ICVIP 2018), 2018, : 218 - 221
  • [6] Siamese network tracking using template updating and trajectory prediction
    He, Wangpeng
    Hu, Deshun
    Li, Cheng
    Zhou, Yue
    Guo, Baolong
    Xi'an Dianzi Keji Daxue Xuebao/Journal of Xidian University, 2024, 51 (03): : 46 - 54
  • [7] Template-Refine Network for Siamese Object Tracking
    Lu, Xiaofeng
    Li, Gaoxiang
    Yan, Zhaoyu
    Teng, Lin
    IEEJ TRANSACTIONS ON ELECTRICAL AND ELECTRONIC ENGINEERING, 2024, 19 (10) : 1652 - 1660
  • [8] Adaptive Hierarchical Siamese Network for Object Tracking
    Fang, Yongfeng
    Wu, Yun
    Sun, Bingyu
    Cui, Chaoyuan
    PROCEEDINGS OF ICRCA 2018: 2018 THE 3RD INTERNATIONAL CONFERENCE ON ROBOTICS, CONTROL AND AUTOMATION / ICRMV 2018: 2018 THE 3RD INTERNATIONAL CONFERENCE ON ROBOTICS AND MACHINE VISION, 2018, : 249 - 254
  • [9] Dynamic template updating Siamese network based on status feedback with quality evaluation for visual object tracking
    Sun, Lifan
    Li, Xinxiang
    Gao, Dan
    Fan, Bo
    JOURNAL OF ELECTRONIC IMAGING, 2024, 33 (01)
  • [10] Occlusion-aware visual object tracking based on multi-template updating Siamese network
    Sun, Lifan
    Zhang, Jiayi
    Gao, Dan
    Fan, Bo
    Fu, Zhumu
    DIGITAL SIGNAL PROCESSING, 2024, 148