HIGH SPEED AND ROBUST RGB-THERMAL TRACKING VIA DUAL ATTENTIVE STREAM SIAMESE NETWORK

被引:4
|
作者
Guo, Chaoyang [1 ]
Xiao, Liang [1 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Nanjing, Peoples R China
基金
中国国家自然科学基金;
关键词
Object tracking; RGB-T tracking; Deep learning; Attention mechanism;
D O I
10.1109/IGARSS46834.2022.9883659
中图分类号
P [天文学、地球科学];
学科分类号
07 ;
摘要
To meet the need of robust tracking in some cases (e.g., extremely illumination and thermal crossover), plenty of RGB-T tracking methods have been proposed in recent years. However, many of them can hardly meet the realtime standard since they are difficult to balance the robustness and the speed. To address such problems, we propose a new Dual Attentive Siamese Network (DASN) for RGB-T tracking. Specifically, we use a dual-stream siamese deep learning network to model tracking as a similarity measure task. In addition, to promote the information propagation procedure between two modalities and suppress the interference of background, we design the channel attention module (CAFE Module) and the channel-spatial attention module (CSAFE Module). What's more, the dual modality region proposal sub-network and the strategy of selecting proposal are constructed to boost the performance. The proposed DASN is trained end-to-end offline. Extensive experiments on three real RGB-T tracking datasets show that our tracker achieves very competive results with a high tracking speed over 140 frames per second. Code is released at https://github.com/easycodesniper-afk/SiamCSR.git.
引用
收藏
页码:803 / 806
页数:4
相关论文
共 32 条
  • [1] Real⁃time robust RGB⁃T target tracking based on dual Siamese network
    Fu L.
    Gu W.-B.
    Ai Y.-B.
    Li W.
    Zheng N.
    Wang L.-Y.
    [J]. Jilin Daxue Xuebao (Gongxueban)/Journal of Jilin University (Engineering and Technology Edition), 2022, 52 (12): : 2906 - 2915
  • [2] Three-stream interaction decoder network for RGB-thermal salient object detection
    Huo, Fushuo
    Zhu, Xuegui
    Li, Bingheng
    [J]. KNOWLEDGE-BASED SYSTEMS, 2022, 258
  • [3] DHFNet: dual-decoding hierarchical fusion network for RGB-thermal semantic segmentation
    Cai, Yuqi
    Zhou, Wujie
    Zhang, Liting
    Yu, Lu
    Luo, Ting
    [J]. VISUAL COMPUTER, 2024, 40 (01): : 169 - 179
  • [4] DHFNet: dual-decoding hierarchical fusion network for RGB-thermal semantic segmentation
    Yuqi Cai
    Wujie Zhou
    Liting Zhang
    Lu Yu
    Ting Luo
    [J]. The Visual Computer, 2024, 40 : 169 - 179
  • [5] Robust Visual Tracking Algorithm Based on Siamese Network with Dual Templates
    Hou Zhiqiang
    Chen Lilin
    Yu Wangsheng
    Ma Sugang
    Fan Jiulun
    [J]. JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2019, 41 (09) : 2247 - 2255
  • [6] Cross-Collaborative Fusion-Encoder Network for Robust RGB-Thermal Salient Object Detection
    Liao, Guibiao
    Gao, Wei
    Li, Ge
    Wang, Junle
    Kwong, Sam
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (11) : 7646 - 7661
  • [7] DFSTrack: Dual-stream fusion Siamese network for human pose tracking in videos
    Wang, Xiangyang
    Tian, Yuhui
    Geng, Fudi
    Wang, Rui
    [J]. IMAGE AND VISION COMPUTING, 2024, 148
  • [8] Siamese Anchor Proposal Network for High-Speed Aerial Tracking
    Fu, Changhong
    Cao, Ziang
    Li, Yiming
    Ye, Junjie
    Feng, Chen
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2021), 2021, : 510 - 516
  • [9] Dual Siamese network for RGBT tracking via fusing predicted position maps
    Guo, Chang
    Yang, Dedong
    Li, Chang
    Song, Peng
    [J]. VISUAL COMPUTER, 2022, 38 (07): : 2555 - 2567
  • [10] Dual Siamese network for RGBT tracking via fusing predicted position maps
    Chang Guo
    Dedong Yang
    Chang Li
    Peng Song
    [J]. The Visual Computer, 2022, 38 : 2555 - 2567