Remote sensing target tracking in satellite videos based on a variable-angle-adaptive Siamese network

被引:9
|
作者
Bi, Fukun [1 ]
Sun, Jiayi [1 ]
Han, Jianhong [1 ]
Wang, Yanping [1 ]
Bian, Mingming [2 ]
机构
[1] North China Univ Technol, Dept Sch Informat Sci & Technol, Beijing, Peoples R China
[2] Beijing Inst Spacecraft Syst Engn, Qian Xuesen Lab, Beijing, Peoples R China
关键词
Deep neural networks - Complex networks - Clutter (information theory) - Convolution - Remote sensing - Target tracking;
D O I
10.1049/ipr2.12170
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Remote sensing target tracking in satellite videos plays a key role in various fields. However, due to the complex backgrounds of satellite video sequences and many rotation changes of highly dynamic targets, typical target tracking methods for natural scenes cannot be used directly for such tasks, and their robustness and accuracy are difficult to guarantee. To address these problems, an algorithm is proposed for remote sensing target tracking in satellite videos based on a variable-angle-adaptive Siamese network (VAASN). Specifically, the method is based on the fully convolutional Siamese network (Siamese-FC). First, for the feature extraction stage, to reduce the impact of complex backgrounds, we present a new multifrequency feature representation method and introduce the octave convolution (OctConv) into the AlexNet architecture to adapt to the new feature representation. Then, for the tracking stage, to adapt to changes in target rotation, a variable-angle-adaptive module that uses a fast text detector with a single deep neural network (TextBoxes++) is introduced to extract angle information from the template frame and detection frames and performs angle consistency update operations on the detection frames. Finally, qualitative and quantitative experiments using satellite datasets show that the proposed method can improve tracking accuracy while achieving high efficiency.
引用
收藏
页码:1987 / 1997
页数:11
相关论文
共 50 条
  • [41] VISUAL LOCALIZATION BASED ON REMOTE SENSING SCENE MATCHING WITH SIAMESE FEATURE AGGREGATION NETWORK
    Chen, Wang
    Yuan, Yuan
    Liu, Ganchao
    [J]. IGARSS 2020 - 2020 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2020, : 6738 - 6741
  • [42] Adaptive Multi-Feature Fusion Visual Target Tracking Based on Siamese Neural Network with Cross-Attention Mechanism
    Zhou, Qian
    Xia, Haoran
    Yan, Hongzheng
    Yang, Ming
    Chen, Shidong
    [J]. 2022 22ND IEEE/ACM INTERNATIONAL SYMPOSIUM ON CLUSTER, CLOUD AND INTERNET COMPUTING (CCGRID 2022), 2022, : 307 - 316
  • [43] Target Tracking Algorithm For Specific Person Based On Multi-Loss Of Siamese Network
    Liu, Xinhua
    Zhong, Yunya
    Ma, Xiaolin
    Kuang, Hailan
    [J]. 2019 11TH INTERNATIONAL CONFERENCE ON MEASURING TECHNOLOGY AND MECHATRONICS AUTOMATION (ICMTMA 2019), 2019, : 485 - 489
  • [44] Research on Siamese network algorithm based on parallel channel attention mechanism for target tracking
    Han, Ming
    Lu, Zhijia
    Wang, Jingtao
    Zhang, Tongqiang
    [J]. JOURNAL OF COMPUTATIONAL METHODS IN SCIENCES AND ENGINEERING, 2023, 23 (04) : 1829 - 1845
  • [45] Real⁃time robust RGB⁃T target tracking based on dual Siamese network
    Fu, Lei
    Gu, Wen-Bin
    Ai, Yong-Bao
    Li, Wei
    Zheng, Nan
    Wang, Liu-Yang
    [J]. Jilin Daxue Xuebao (Gongxueban)/Journal of Jilin University (Engineering and Technology Edition), 2022, 52 (12): : 2906 - 2915
  • [46] Vehicle Detection and Tracking in Remote Sensing Satellite Vidio Based on Dynamic Association
    Zhang, Jinyue
    Zhang, Xiangrong
    Tang, Xu
    Huang, Zhongjian
    Jiao, Licheng
    [J]. 2019 10TH INTERNATIONAL WORKSHOP ON THE ANALYSIS OF MULTITEMPORAL REMOTE SENSING IMAGES (MULTITEMP), 2019,
  • [47] Remote Sensing Video Target Tracking Based on Reliability Learning Multi-Domain Convolutional Neural Network
    Bi, Fu-Kun
    Lei, Ming-Yang
    Chen, Liang
    Sun, Jia-Yi
    [J]. Beijing Ligong Daxue Xuebao/Transaction of Beijing Institute of Technology, 2019, 39 : 98 - 102
  • [48] Siam-Sort: Multi-Target Tracking in Video SAR Based on Tracking by Detection and Siamese Network
    Fang, Hui
    Liao, Guisheng
    Liu, Yongjun
    Zeng, Cao
    [J]. REMOTE SENSING, 2023, 15 (01)
  • [49] UAV target tracking algorithm based on adaptive depth network
    Liu F.
    Wang H.
    Huang G.
    Lu L.
    Wang X.
    [J]. Hangkong Xuebao/Acta Aeronautica et Astronautica Sinica, 2019, 40 (03):
  • [50] UAV target tracking algorithm based on adaptive fusion network
    Liu, Fang
    Sun, Yanan
    [J]. Hangkong Xuebao/Acta Aeronautica et Astronautica Sinica, 2022, 43 (07):