Siamese Trackers Based on Deep Features for Visual Tracking

被引:2
|
作者
Lim, Su-Chang [1 ]
Huh, Jun-Ho [2 ,3 ]
Kim, Jong-Chan [1 ]
机构
[1] Sunchon Natl Univ, Dept Comp Engn, Sunchon 57992, South Korea
[2] Natl Korea Maritime & Ocean Univ, Dept Data Sci, Busan 49112, South Korea
[3] Natl Korea Maritime & Ocean Univ, Interdisciplinary Major Ocean Renewable Energy Eng, Busan 49112, South Korea
关键词
object tracking; convolution neural network; artificial intelligence; Siamese network; image similarity; computer vision; OBJECT TRACKING; ROBUST;
D O I
10.3390/electronics12194140
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Visual object tracking poses challenges due to deformation of target object appearance, fast motion, brightness change, blocking due to obstacles, etc. In this paper, a Siamese network that is configured using a convolutional neural network is proposed to improve tracking accuracy and robustness. Object tracking accuracy is dependent on features that can well represent objects. Thus, we designed a convolutional neural network structure that can preserve feature information that is produced in the previous layer to extract spatial and semantic information. Features are extracted from the target object and search area using a Siamese network, and the extracted feature map is input into the region proposal network, where fast Fourier-transform convolution is applied. The feature map produces a probability score for the presence of an object region and an object in a region, where the similarities are high to search the target. The network was trained with a video dataset called ImageNet Large Scale Visual Recognition Challenge. In the experiment, quantitative and qualitative evaluations were conducted using the object-tracking benchmark dataset. The evaluation results indicated competitive results for some video attributes through various experiments. By conducting experiments, the proposed method achieved competitive results for some video attributes, with a success metric of 0.632 and a precision metric of 0.856 as quantitative values.
引用
收藏
页数:18
相关论文
共 50 条
  • [1] Motion Guided Siamese Trackers for Visual Tracking
    Wu, Chenglong
    Zhang, Yue
    Zhang, Yi
    Zhang, Wenkai
    Wang, Hongqi
    Zhang, Yunyan
    Sun, Xian
    [J]. IEEE ACCESS, 2020, 8 : 7473 - 7489
  • [2] Siamese Visual Tracking With Deep Features and Robust Feature Fusion
    Li, Daqun
    Wang, Xize
    Yu, Yi
    [J]. IEEE ACCESS, 2020, 8 : 3863 - 3874
  • [3] Siamese Network Based Features Fusion for Adaptive Visual Tracking
    Guo, Dongyan
    Zhao, Weixuan
    Cui, Ying
    Wang, Zhenhua
    Chen, Shengyong
    Zhang, Jian
    [J]. PRICAI 2018: TRENDS IN ARTIFICIAL INTELLIGENCE, PT I, 2018, 11012 : 759 - 771
  • [4] Deep Feature Based Siamese Network for Visual Object Tracking
    Lim, Su-Chang
    Huh, Jun-Ho
    Kim, Jong-Chan
    [J]. ENERGIES, 2022, 15 (17)
  • [5] Robust Visual Tracking Based on Adaptive Convolutional Features and Offline Siamese Tracker
    Zhang, Ximing
    Wang, Mingang
    [J]. SENSORS, 2018, 18 (07)
  • [6] Tracking Failure Prediction for Siamese Trackers Based on Channel Feature Statistics
    Lee, Kyuewang
    Do, Hoseok
    Ha, Taegil
    Choi, Jongwon
    Choi, Jin Young
    [J]. 2022 18TH IEEE INTERNATIONAL CONFERENCE ON ADVANCED VIDEO AND SIGNAL BASED SURVEILLANCE (AVSS 2022), 2022,
  • [7] A deep features based generative model for visual tracking
    Feng, Ping
    Xu, Chunyan
    Zhao, Zhiqiang
    Liu, Fang
    Guo, Jingjuan
    Yuan, Caihong
    Wang, Tianjiang
    Duan, Kui
    [J]. NEUROCOMPUTING, 2018, 308 : 245 - 254
  • [8] Multiple Context Features in Siamese Networks for Visual Object Tracking
    Morimitsu, Henrique
    [J]. COMPUTER VISION - ECCV 2018 WORKSHOPS, PT I, 2019, 11129 : 116 - 131
  • [9] Siamese Natural Language Tracker: Tracking by Natural Language Descriptions with Siamese Trackers
    Feng, Qi
    Ablavsky, Vitaly
    Bai, Qinxun
    Sclaroff, Stan
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 5847 - 5856
  • [10] Ranking-Based Siamese Visual Tracking
    Tang, Feng
    Ling, Qiang
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 8731 - 8740