HIGH SPEED AND ROBUST RGB-THERMAL TRACKING VIA DUAL ATTENTIVE STREAM SIAMESE NETWORK

被引:4
|
作者
Guo, Chaoyang [1 ]
Xiao, Liang [1 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Nanjing, Peoples R China
基金
中国国家自然科学基金;
关键词
Object tracking; RGB-T tracking; Deep learning; Attention mechanism;
D O I
10.1109/IGARSS46834.2022.9883659
中图分类号
P [天文学、地球科学];
学科分类号
07 ;
摘要
To meet the need of robust tracking in some cases (e.g., extremely illumination and thermal crossover), plenty of RGB-T tracking methods have been proposed in recent years. However, many of them can hardly meet the realtime standard since they are difficult to balance the robustness and the speed. To address such problems, we propose a new Dual Attentive Siamese Network (DASN) for RGB-T tracking. Specifically, we use a dual-stream siamese deep learning network to model tracking as a similarity measure task. In addition, to promote the information propagation procedure between two modalities and suppress the interference of background, we design the channel attention module (CAFE Module) and the channel-spatial attention module (CSAFE Module). What's more, the dual modality region proposal sub-network and the strategy of selecting proposal are constructed to boost the performance. The proposed DASN is trained end-to-end offline. Extensive experiments on three real RGB-T tracking datasets show that our tracker achieves very competive results with a high tracking speed over 140 frames per second. Code is released at https://github.com/easycodesniper-afk/SiamCSR.git.
引用
下载
收藏
页码:803 / 806
页数:4
相关论文
共 32 条
  • [21] Visual encoder: robust and precise measurement method of rotation angle via high-speed RGB vision
    Kim, Hyuno
    Yamakawa, Yuji
    Senoo, Taku
    Ishikawa, Masatoshi
    OPTICS EXPRESS, 2016, 24 (12): : 13375 - 13386
  • [22] SiamOHOT: A Lightweight Dual Siamese Network for Onboard Hyperspectral Object Tracking via Joint Spatial-Spectral Knowledge Distillation
    Sun, Chen
    Wang, Xinyu
    Liu, Zhenqi
    Wan, Yuting
    Zhang, Liangpei
    Zhong, Yanfei
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [23] High-speed dual-stream transport solution for uncompressed HD video over gigabit network
    Muhammad, Faisal
    Kim, JongWon
    MULTIMEDIA SYSTEMS AND APPLICATIONS IX, 2006, 6391
  • [24] Design of a robust intelligent controller based neural network for trajectory tracking of high-speed wheeled robots
    Xue, Wenkui
    Zhou, Baozhi
    Chen, Fenghua
    Ghaderpour, Ebrahim
    Mohammadzadeh, Ardashir
    Physica Scripta, 2024, 99 (11)
  • [25] Learning control for position tracking of active suspension of high-speed AGV via neural network
    Xue, HR
    Cheung, EHM
    ETFA '96 - 1996 IEEE CONFERENCE ON EMERGING TECHNOLOGIES AND FACTORY AUTOMATION, PROCEEDINGS, VOLS 1 AND 2, 1996, : 523 - 527
  • [26] Research on Robust Model Predictive Control Based on Neural Network Optimization for Trajectory Tracking of High-Speed Autonomous Vehicles
    Liu, Fei
    Qin, Ping
    Guo, Zhizhong
    Shang, Yuze
    Li, Zhe
    TRANSPORTATION RESEARCH RECORD, 2024,
  • [27] Fused Thermal and RGB Imagery for Robust Detection and Classification of Dynamic Objects in Mixed Datasets via Pre-Trained High-Level CNN
    Ben-Shoushan, Ravit
    Brook, Anna
    REMOTE SENSING, 2023, 15 (03)
  • [28] A mechanically robust double-network hydrogel with high thermal responses via doping hydroxylated boron nitride nanosheets
    Xing, Lu
    Hu, Chengxin
    Zhang, Yulin
    Wang, Xiangdong
    Shi, Lingying
    Ran, Rong
    JOURNAL OF MATERIALS SCIENCE, 2019, 54 (04) : 3368 - 3382
  • [29] A mechanically robust double-network hydrogel with high thermal responses via doping hydroxylated boron nitride nanosheets
    Lu Xing
    Chengxin Hu
    Yulin Zhang
    Xiangdong Wang
    Lingying Shi
    Rong Ran
    Journal of Materials Science, 2019, 54 : 3368 - 3382
  • [30] Robust bipartite tracking consensus of multi-agent systems via neural network combined with extended high-gain observer
    Li, Weihao
    Qin, Kaiyu
    Li, Gun
    Shi, Mengji
    Zhang, Xinyu
    ISA TRANSACTIONS, 2023, 136 : 31 - 45