HIGH SPEED AND ROBUST RGB-THERMAL TRACKING VIA DUAL ATTENTIVE STREAM SIAMESE NETWORK

被引:4
|
作者
Guo, Chaoyang [1 ]
Xiao, Liang [1 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Nanjing, Peoples R China
基金
中国国家自然科学基金;
关键词
Object tracking; RGB-T tracking; Deep learning; Attention mechanism;
D O I
10.1109/IGARSS46834.2022.9883659
中图分类号
P [天文学、地球科学];
学科分类号
07 ;
摘要
To meet the need of robust tracking in some cases (e.g., extremely illumination and thermal crossover), plenty of RGB-T tracking methods have been proposed in recent years. However, many of them can hardly meet the realtime standard since they are difficult to balance the robustness and the speed. To address such problems, we propose a new Dual Attentive Siamese Network (DASN) for RGB-T tracking. Specifically, we use a dual-stream siamese deep learning network to model tracking as a similarity measure task. In addition, to promote the information propagation procedure between two modalities and suppress the interference of background, we design the channel attention module (CAFE Module) and the channel-spatial attention module (CSAFE Module). What's more, the dual modality region proposal sub-network and the strategy of selecting proposal are constructed to boost the performance. The proposed DASN is trained end-to-end offline. Extensive experiments on three real RGB-T tracking datasets show that our tracker achieves very competive results with a high tracking speed over 140 frames per second. Code is released at https://github.com/easycodesniper-afk/SiamCSR.git.
引用
下载
收藏
页码:803 / 806
页数:4
相关论文
共 32 条
  • [11] A location-aware siamese network for high-speed visual tracking
    Lifang Zhou
    Xiang Ding
    Weisheng Li
    Jiaxu Leng
    Bangjun Lei
    Weibin Yang
    Applied Intelligence, 2023, 53 : 4431 - 4447
  • [12] MobileTrack: Siamese efficient mobile network for high-speed UAV tracking
    Xue, Yuanliang
    Jin, Guodong
    Shen, Tao
    Tan, Lining
    Yang, Jing
    Hou, Xiaohan
    IET IMAGE PROCESSING, 2022, 16 (12) : 3300 - 3313
  • [13] A location-aware siamese network for high-speed visual tracking
    Zhou, Lifang
    Ding, Xiang
    Li, Weisheng
    Leng, Jiaxu
    Lei, Bangjun
    Yang, Weibin
    APPLIED INTELLIGENCE, 2023, 53 (04) : 4431 - 4447
  • [14] Real-Time One-Stream Semantic-Guided Refinement Network for RGB-Thermal Salient Object Detection
    Huo, Fushuo
    Zhu, Xuegui
    Zhang, Qian
    Liu, Ziming
    Yu, Wenchao
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71
  • [15] Dual-Space Graph-Based Interaction Network for RGB-Thermal Semantic Segmentation in Electric Power Scene
    Xu, Chang
    Li, Qingwu
    Jiang, Xiongbiao
    Yu, Dabing
    Zhou, Yaqin
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (04) : 1577 - 1592
  • [16] Region-based High-resolution Siamese Network for Robust Visual Tracking
    Li, Chunbao
    Yang, Bo
    PROCEEDINGS OF 2019 4TH INTERNATIONAL CONFERENCE ON BIOMEDICAL SIGNAL AND IMAGE PROCESSING (ICBIP 2019), 2019, : 107 - 112
  • [17] High performance RGB-Thermal Video Object Detection via hybrid fusion with progressive interaction and temporal-modal difference
    Wang, Qishun
    Tu, Zhengzheng
    Li, Chenglong
    Tang, Jin
    Information Fusion, 2025,
  • [18] Robust Single-object Visual Tracking Framework via Fully Convolutional Siamese Network with Correlation Filter
    Dai, Jiashu
    Yan, Nan
    2020 13TH INTERNATIONAL SYMPOSIUM ON COMPUTATIONAL INTELLIGENCE AND DESIGN (ISCID 2020), 2020, : 359 - 363
  • [19] SiamSEA: Semantic-Aware Enhancement and Associative-Attention Dual-Modal Siamese Network for Robust RGBT Tracking
    Zhuang, Zihan
    Yin, Mingfeng
    Gao, Qi
    Lin, Yong
    Hong, Xing
    IEEE Access, 2024, 12 : 134874 - 134887
  • [20] DUAL-BRANCH SIAMESE NETWORK FOR OBJECT TRACKING BASED ON ATTENTION AND LOW-HIGH-RESOLUTION IMAGES
    Zhou, Shuren
    Li, Zhixiong
    Liu, Jie
    Zhou, Jiarui
    Zhang, Jianming
    APPLIED AND COMPUTATIONAL MATHEMATICS, 2023, 22 (03) : 409 - 429