Single Object Tracking in Satellite Videos Based on Feature Enhancement and Multi-Level Matching Strategy

被引:5
|
作者
Yang, Jianwei [1 ,2 ,3 ]
Pan, Zongxu [1 ,2 ,3 ]
Liu, Yuhan [1 ,2 ]
Niu, Ben [1 ,2 ,3 ]
Lei, Bin [1 ,2 ,3 ]
机构
[1] Chinese Acad Sci, Aerosp Informat Res Inst, Beijing 100094, Peoples R China
[2] Chinese Acad Sci, Key Lab Technol Geospatial Informat Proc & Applica, Beijing 100190, Peoples R China
[3] Univ Chinese Acad Sci, Sch Elect Elect & Commun Engn, Beijing 100049, Peoples R China
关键词
satellite video; object tracking; siamese network; feature enhancement; matching strategy; SIAMESE NETWORKS;
D O I
10.3390/rs15174351
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Despite significant advancements in remote sensing object tracking (RSOT) in recent years, achieving accurate and continuous tracking of tiny-sized targets remains a challenging task due to similar object interference and other related issues. In this paper, from the perspective of feature enhancement and a better feature matching strategy, we present a tracker SiamTM specifically designed for RSOT, which is mainly based on a new target information enhancement (TIE) module and a multi-level matching strategy. First, we propose a TIE module to address the challenge of tiny object sizes in satellite videos. The proposed TIE module goes along two spatial directions to capture orientation and position-aware information, respectively, while capturing inter-channel information at the global 2D image level. The TIE module enables the network to extract discriminative features of the targets more effectively from satellite images. Furthermore, we introduce a multi-level matching (MM) module that is better suited for satellite video targets. The MM module firstly embeds the target feature map after ROI Align into each position of the search region feature map to obtain a preliminary response map. Subsequently, the preliminary response map and the template region feature map are subjected to the Depth-wise Cross Correlation operation to get a more refined response map. Through this coarse-to-fine approach, the tracker obtains a response map with a more accurate position, which lays a good foundation for the prediction operation of the subsequent sub-networks. We conducted extensive experiments on two large satellite video single-object tracking datasets: SatSOT and SV248S. Without bells and whistles, the proposed tracker SiamTM achieved competitive results on both datasets while running at real-time speed.
引用
收藏
页数:25
相关论文
共 50 条
  • [1] Multi-level temporal feature fusion with feature exchange strategy for multiple object tracking
    Ge, Yisu
    Ye, Wenjie
    Zhang, Guodao
    Lin, Mengying
    [J]. OPTOELECTRONICS LETTERS, 2024, 20 (08) : 505 - 512
  • [2] Multi-level temporal feature fusion with feature exchange strategy for multiple object tracking
    GE Yisu
    YE Wenjie
    ZHANG Guodao
    LIN Mengying
    [J]. Optoelectronics Letters., 2024, 20 (08) - 512
  • [3] Deep feature based correlation filter for single object tracking in satellite videos
    Sharma, Devendra
    Srivastava, Rajeev
    [J]. SIGNAL IMAGE AND VIDEO PROCESSING, 2024, 18 (8-9) : 6443 - 6454
  • [4] Triplet Network with Multi-level Feature Fusion for Object Tracking
    Cao, Yang
    Wan, Bo
    Wang, Quan
    Cheng, Fei
    [J]. 2020 JOINT 9TH INTERNATIONAL CONFERENCE ON INFORMATICS, ELECTRONICS & VISION (ICIEV) AND 2020 4TH INTERNATIONAL CONFERENCE ON IMAGING, VISION & PATTERN RECOGNITION (ICIVPR), 2020,
  • [5] Multi-level feature enhancement network for object detection in sonar images
    Zhou, Xin
    Zhou, Zihan
    Wang, Manying
    Ning, Bo
    Wang, Yanhao
    Zhu, Pengli
    [J]. JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2024, 100
  • [6] Object Tracking in Satellite Videos Based on Correlation Filter with Multi-Feature Fusion and Motion Trajectory Compensation
    Liu, Yaosheng
    Liao, Yurong
    Lin, Cunbao
    Jia, Yutong
    Li, Zhaoming
    Yang, Xinyan
    [J]. REMOTE SENSING, 2022, 14 (03)
  • [7] A Virtual Keyboard System Based on Multi-Level Feature Matching
    Du, Huan
    Charbon, Edoardo
    [J]. 2008 CONFERENCE ON HUMAN SYSTEM INTERACTIONS, VOLS 1 AND 2, 2008, : 170 - 175
  • [8] JDE multi-object tracking algorithm integrating multi-level semantic enhancement
    Wang, Jun
    Wang, Peng
    Li, Xiaoyan
    Wang, Liang
    Sun, Mengyu
    Gao, Hui
    [J]. Xibei Gongye Daxue Xuebao/Journal of Northwestern Polytechnical University, 2022, 40 (04): : 944 - 952
  • [9] Object Tracking in Satellite Videos Based on a Lightweight Network
    Sui, Bing
    Xu, Meng
    Li, Dongdong
    [J]. JOURNAL OF CIRCUITS SYSTEMS AND COMPUTERS, 2021, 30 (06)
  • [10] Object Tracking Based on Satellite Videos: A Literature Review
    Zhang, Zhaoxiang
    Wang, Chenghang
    Song, Jianing
    Xu, Yuelei
    [J]. REMOTE SENSING, 2022, 14 (15)