Contextual Enhancement-Interaction and Multi-Scale Weighted Fusion Network for Aerial Tracking

被引:0
|
作者
Wang, Bo [1 ,2 ]
Wang, Xuan [1 ]
Ma, Linglong [1 ,2 ]
Zuo, Yujia [1 ]
Liu, Chenglong [1 ]
机构
[1] Chinese Acad Sci, Changchun Inst Opt Fine Mech & Phys, Changchun 130033, Peoples R China
[2] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
基金
中国国家自然科学基金;
关键词
aerial tracking; UAV visual object tracking; Siamese tracker; contextual enhancement-interaction; multi-scale fusion; PLUS PLUS;
D O I
10.3390/drones8080343
中图分类号
TP7 [遥感技术];
学科分类号
081102 ; 0816 ; 081602 ; 083002 ; 1404 ;
摘要
Siamese-based trackers have been widely utilized in UAV visual tracking due to their outstanding performance. However, UAV visual tracking encounters numerous challenges, such as similar targets, scale variations, and background clutter. Existing Siamese trackers face two significant issues: firstly, they rely on single-branch features, limiting their ability to achieve long-term and accurate aerial tracking. Secondly, current tracking algorithms treat multi-level similarity responses equally, making it difficult to ensure tracking accuracy in complex airborne environments. To tackle these challenges, we propose a novel UAV tracking Siamese network named the contextual enhancement-interaction and multi-scale weighted fusion network, which is designed to improve aerial tracking performance. Firstly, we designed a contextual enhancement-interaction module to improve feature representation. This module effectively facilitates the interaction between the template and search branches and strengthens the features of each branch in parallel. Specifically, a cross-attention mechanism within the module integrates the branch information effectively. The parallel Transformer-based enhancement structure improves the feature saliency significantly. Additionally, we designed an efficient multi-scale weighted fusion module that adaptively weights the correlation response maps across different feature scales. This module fully utilizes the global similarity response between the template and the search area, enhancing feature distinctiveness and improving tracking results. We conducted experiments using several state-of-the-art trackers on aerial tracking benchmarks, including DTB70, UAV123, UAV20L, and UAV123@10fps, to validate the efficacy of the proposed network. The experimental results demonstrate that our tracker performs effectively in complex aerial tracking scenarios and competes well with state-of-the-art trackers.
引用
收藏
页数:20
相关论文
共 50 条
  • [1] A Multi-Scale Contextual Information Enhancement Network for Crack Segmentation
    Zhang, Lili
    Liao, Yang
    Wang, Gaoxu
    Chen, Jun
    Wang, Huibin
    APPLIED SCIENCES-BASEL, 2022, 12 (21):
  • [2] An underwater imaging method of enhancement via multi-scale weighted fusion
    Zhang, Hao
    Gong, Longxiang
    Li, Xiangchun
    Liu, Fei
    Yin, Jiawei
    FRONTIERS IN MARINE SCIENCE, 2023, 10
  • [3] Contextual and Multi-Scale Feature Fusion Network for Traffic Sign Detection
    Zhang, Wei
    Wang, Qiang
    Fan, Huijie
    Tang, Yandong
    2020 10TH INSTITUTE OF ELECTRICAL AND ELECTRONICS ENGINEERS INTERNATIONAL CONFERENCE ON CYBER TECHNOLOGY IN AUTOMATION, CONTROL, AND INTELLIGENT SYSTEMS (IEEE-CYBER 2020), 2020, : 13 - 17
  • [4] Multi-Scale Feature Interactive Fusion Network for RGBT Tracking
    Xiao, Xianbing
    Xiong, Xingzhong
    Meng, Fanqin
    Chen, Zhen
    SENSORS, 2023, 23 (07)
  • [5] MCANet: multi-scale contextual feature fusion network based on Atrous convolution
    Li, Ke
    Liu, ZhanDong
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (22) : 34679 - 34702
  • [6] MCANet: multi-scale contextual feature fusion network based on Atrous convolution
    Ke Li
    ZhanDong Liu
    Multimedia Tools and Applications, 2023, 82 : 34679 - 34702
  • [7] MFEFNet: A Multi-Scale Feature Information Extraction and Fusion Network for Multi-Scale Object Detection in UAV Aerial Images
    Zhou, Liming
    Zhao, Shuai
    Wan, Ziye
    Liu, Yang
    Wang, Yadi
    Zuo, Xianyu
    DRONES, 2024, 8 (05)
  • [8] Low Light Image Enhancement Based on Multi-Scale Network Fusion
    Liu, Xuan
    Zhang, Chenfeng
    Wang, Yingzhi
    Ding, Kai
    Han, Tailin
    Liu, Hong
    Tian, Yu
    Xu, Bo
    Ju, Mingchi
    IEEE ACCESS, 2022, 10 : 127853 - 127862
  • [9] MFEFNet: Multi-scale feature enhancement and Fusion Network for polyp segmentation
    Xia, Yang
    Yun, Haijiao
    Liu, Yanjun
    COMPUTERS IN BIOLOGY AND MEDICINE, 2023, 157
  • [10] Multi-step prediction of roof pressure based on multi-scale contextual fusion network
    Zhang, Yuhai
    Yu, Qiongfang
    Tang, Gaofeng
    Wu, Qiong
    SENSORS AND ACTUATORS A-PHYSICAL, 2024, 369