Remote sensing target tracking in satellite videos based on a variable-angle-adaptive Siamese network

被引:9
|
作者
Bi, Fukun [1 ]
Sun, Jiayi [1 ]
Han, Jianhong [1 ]
Wang, Yanping [1 ]
Bian, Mingming [2 ]
机构
[1] North China Univ Technol, Dept Sch Informat Sci & Technol, Beijing, Peoples R China
[2] Beijing Inst Spacecraft Syst Engn, Qian Xuesen Lab, Beijing, Peoples R China
关键词
This work was supported in part by the National Natural Science Foundation of China (Grant No. 61971006); Natural Science Foundation of Beijing Municipal (No. 4192021);
D O I
10.1049/ipr2.12170
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Remote sensing target tracking in satellite videos plays a key role in various fields. However, due to the complex backgrounds of satellite video sequences and many rotation changes of highly dynamic targets, typical target tracking methods for natural scenes cannot be used directly for such tasks, and their robustness and accuracy are difficult to guarantee. To address these problems, an algorithm is proposed for remote sensing target tracking in satellite videos based on a variable-angle-adaptive Siamese network (VAASN). Specifically, the method is based on the fully convolutional Siamese network (Siamese-FC). First, for the feature extraction stage, to reduce the impact of complex backgrounds, we present a new multifrequency feature representation method and introduce the octave convolution (OctConv) into the AlexNet architecture to adapt to the new feature representation. Then, for the tracking stage, to adapt to changes in target rotation, a variable-angle-adaptive module that uses a fast text detector with a single deep neural network (TextBoxes++) is introduced to extract angle information from the template frame and detection frames and performs angle consistency update operations on the detection frames. Finally, qualitative and quantitative experiments using satellite datasets show that the proposed method can improve tracking accuracy while achieving high efficiency.
引用
收藏
页码:1987 / 1997
页数:11
相关论文
共 50 条
  • [1] Adaptive Siamese network based UAV target tracking algorithm
    Liu, Fang
    Yang, Anzhe
    Wu, Zhiwei
    [J]. Hangkong Xuebao/Acta Aeronautica et Astronautica Sinica, 2020, 41 (01):
  • [2] Deep Siamese Network With Motion Fitting for Object Tracking in Satellite Videos
    Ruan, Lu
    Guo, Yujia
    Yang, Daiqin
    Chen, Zhenzhong
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [3] Remote Sensing: Detecting and Tracking Vehicles on Satellite Images and Videos
    Zerubia, Josiane
    Hauseux, Louis
    [J]. ERCIM NEWS, 2023, (133): : 47 - 48
  • [4] A Collaborative Learning Tracking Network for Remote Sensing Videos
    Li, Xiaotong
    Jiao, Licheng
    Zhu, Hao
    Liu, Fang
    Yang, Shuyuan
    Zhang, Xiangrong
    Wang, Shuang
    Qu, Rong
    [J]. IEEE TRANSACTIONS ON CYBERNETICS, 2023, 53 (03) : 1954 - 1967
  • [5] Adaptive Image Dehazing and Object Tracking in UAV Videos Based on the Template Updating Siamese Network
    Sun, Lifan
    Chang, Jiashun
    Zhang, Jinjin
    Fan, Bo
    He, Zishu
    [J]. IEEE SENSORS JOURNAL, 2023, 23 (11) : 12320 - 12333
  • [6] Siamese Multi-Scale Adaptive Search Network for Remote Sensing Single-Object Tracking
    Hou, Biao
    Cui, Yanyu
    Ren, Zhongle
    Li, Zhihao
    Wang, Shuang
    Jiao, Licheng
    [J]. REMOTE SENSING, 2023, 15 (17)
  • [7] Hierarchical Convolution Fusion-Based Adaptive Siamese Network for Infrared Target Tracking
    Xu, Yunkai
    Wan, Minjie
    Chen, Qian
    Qian, Weixian
    Ren, Kan
    Gu, Guohua
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2021, 70
  • [8] A Joint Siamese Attention-Aware Network for Vehicle Object Tracking in Satellite Videos
    Song, Wei
    Jiao, Licheng
    Liu, Fang
    Liu, Xu
    Li, Lingling
    Yang, Shuyuan
    Hou, Biao
    Zhang, Wenhua
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [9] Target tracking based on deformable convolution siamese network
    Liu, Ru-Hao
    Zhang, Jia-Xiang
    Jin, Chen-Xi
    Lu, Xian-Ling
    [J]. Kongzhi yu Juece/Control and Decision, 2022, 37 (08): : 2049 - 2055
  • [10] Object Tracking in Satellite Videos Based on Siamese Network With Multidimensional Information-Aware and Temporal Motion Compensation
    Nie, Yidan
    Bian, Chunjiang
    Li, Ligang
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19