RGB-T image analysis technology and application: A survey

被引:24
|
作者
Song, Kechen [1 ,2 ,3 ]
Zhao, Ying [1 ,2 ,3 ]
Huang, Liming [1 ,2 ,3 ]
Yan, Yunhui [1 ,2 ,3 ]
Meng, Qinggang [4 ]
机构
[1] Northeastern Univ, Sch Mech Engn & Automat, Shenyang 110819, Liaoning, Peoples R China
[2] Northeastern Univ, Natl Frontiers Sci Ctr Ind Intelligence & Syst Opt, Shenyang 110819, Peoples R China
[3] Minist Educ, Key Lab Data Analyt & Optimizat Smart Ind, Shenyang 110819, Liaoning, Peoples R China
[4] Loughborough Univ, Dept Comp Sci, Loughborough LE11 3TU, England
基金
中国国家自然科学基金;
关键词
RGB-T images; Visible-thermal; Image fusion; Salient object detection; Pedestrian detection; Object tracking; Person re-identification; MODALITY PERSON REIDENTIFICATION; GENERATIVE ADVERSARIAL NETWORK; FUSION NETWORK; SEMANTIC SEGMENTATION; PEDESTRIAN DETECTION; SALIENCY DETECTION; ATTENTION NETWORK; SENSOR FUSION; FRAMEWORK; CONSISTENT;
D O I
10.1016/j.engappai.2023.105919
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
RGB-Thermal infrared (RGB-T) image analysis has been actively studied in recent years. In the past decade, it has received wide attention and made a lot of important research progress in many applications. This paper provides a comprehensive review of RGB-T image analysis technology and application, including several hot fields: image fusion, salient object detection, semantic segmentation, pedestrian detection, object tracking, and person re-identification. The first two belong to the preprocessing technology for many computer vision tasks, and the rest belong to the application direction. This paper extensively reviews 400+ papers spanning more than 10 different application tasks. Furthermore, for each specific task, this paper comprehensively analyzes the various methods and presents the performance of the state-of-the-art methods. This paper also makes an in-deep analysis of challenges for RGB-T image analysis as well as some potential technical improvements in the future.
引用
收藏
页数:36
相关论文
共 50 条
  • [1] A Survey of RGB-T Object Tracking Technologies Based on Deep Learning
    Zhang, Tianlu
    Zhang, Qiang
    Moshi Shibie yu Rengong Zhineng/Pattern Recognition and Artificial Intelligence, 2023, 36 (04): : 327 - 353
  • [2] RGB-T Image Saliency Detection via Collaborative Graph Learning
    Tu, Zhengzheng
    Xia, Tian
    Li, Chenglong
    Wang, Xiaoxiao
    Ma, Yan
    Tang, Jin
    IEEE TRANSACTIONS ON MULTIMEDIA, 2020, 22 (01) : 160 - 173
  • [3] RGB-T目标跟踪综述
    丁正彤
    徐磊
    张研
    李飘扬
    李阳阳
    罗斌
    涂铮铮
    南京信息工程大学学报(自然科学版), 2019, 11 (06) : 690 - 697
  • [4] Channel Exchanging for RGB-T Tracking
    Zhao, Long
    Zhu, Meng
    Ren, Honge
    Xue, Lingjixuan
    SENSORS, 2021, 21 (17)
  • [5] Learning Static-Adaptive Graphs for RGB-T Image Saliency Detection
    Xu, Zhengmei
    Tang, Jin
    Zhou, Aiwu
    Liu, Huaming
    INFORMATION, 2022, 13 (02)
  • [6] Multimodal Frequeny Spectrum Fusion Schema for RGB-T Image Semantic Segmentation
    Liu, Hengyan
    Zhang, Wenzhang
    Dai, Tianhong
    Yin, Longfei
    Ren, Guangyu
    2024 33RD INTERNATIONAL CONFERENCE ON COMPUTER COMMUNICATIONS AND NETWORKS, ICCCN 2024, 2024,
  • [7] RGB-T object tracking: Benchmark and baseline
    Li, Chenglong
    Liang, Xinyan
    Lu, Yijuan
    Zhao, Nan
    Tang, Jin
    PATTERN RECOGNITION, 2019, 96
  • [8] RGB-T tracking with frequency hybrid awareness
    Lei, Lei
    Li, Xianxian
    IMAGE AND VISION COMPUTING, 2024, 152
  • [9] Toward Modalities Correlation for RGB-T Tracking
    Hu, Xiantao
    Zhong, Bineng
    Liang, Qihua
    Zhang, Shengping
    Li, Ning
    Li, Xianxian
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (10) : 9102 - 9111
  • [10] RGB-T Object Detection With Failure Scenarios
    Wang, Qingwang
    Sun, Yuxuan
    Chi, Yongke
    Shen, Tao
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2025, 18 : 3000 - 3010