RGB-T Image Saliency Detection via Collaborative Graph Learning

被引:154
|
作者
Tu, Zhengzheng [1 ]
Xia, Tian [1 ]
Li, Chenglong [1 ,2 ]
Wang, Xiaoxiao [1 ]
Ma, Yan [1 ]
Tang, Jin [1 ]
机构
[1] Anhui Univ, Sch Comp Sci & Technol, Minist Educ, Key Lab Intelligent Comp & Signal Proc, Hefei 230601, Peoples R China
[2] Anhui Univ, Inst Phys Sci & Informat Technol, Hefei 230601, Peoples R China
关键词
Image saliency detection; RGB-thermal fusion; Collaborative graph; Joint optimization; Benchmark dataset; OBJECT DETECTION;
D O I
10.1109/TMM.2019.2924578
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Image saliency detection is an active research topic in the community of computer vision and multimedia. Fusing complementary RGB and thermal infrared data has been proven to be effective for image saliency detection. In this paper, we propose an effective approach for RGB-T image saliency detection. Our approach relies on a novel collaborative graph learning algorithm. In particular, we take superpixels as graph nodes, and collaboratively use hierarchical deep features to jointly learn graph affinity and node saliency in a unified optimization framework. Moreover, we contribute a more challenging dataset for the purpose of RGB-T image saliency detection, which contains 1000 spatially aligned RGB-T image pairs and their ground truth annotations. Extensive experiments on the public dataset and the newly created dataset suggest that the proposed approach performs favorably against the state-of-the-art RGB-T saliency detection methods.
引用
收藏
页码:160 / 173
页数:14
相关论文
共 50 条
  • [21] RGB-T image analysis technology and application: A survey
    Song, Kechen
    Zhao, Ying
    Huang, Liming
    Yan, Yunhui
    Meng, Qinggang
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 120
  • [22] SALIENT OBJECT DETECTION FOR RGB-D IMAGE VIA SALIENCY EVOLUTION
    Guo, Jingfan
    Ren, Tongwei
    Bei, Jia
    2016 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA & EXPO (ICME), 2016,
  • [23] A unified RGB-T crowd counting learning framework
    Gu, Siqi
    Lian, Zhichao
    IMAGE AND VISION COMPUTING, 2023, 131
  • [24] Saliency Region Detection via Graph Model and Statistical Learning
    Huang, Ling
    Tang, Songguang
    Hu, Jiani
    Deng, Weihong
    PATTERN RECOGNITION (CCPR 2016), PT II, 2016, 663 : 3 - 13
  • [25] Multi-Graph Fusion and Learning for RGBT Image Saliency Detection
    Huang, Liming
    Song, Kechen
    Wang, Jie
    Niu, Menghui
    Yan, Yunhui
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (03) : 1366 - 1377
  • [26] Feature aggregation with transformer for RGB-T salient object detection
    Zhang, Ping
    Xu, Mengnan
    Zhang, Ziyan
    Gao, Pan
    Zhang, Jing
    NEUROCOMPUTING, 2023, 546
  • [27] FEATURE ENHANCEMENT AND FUSION FOR RGB-T SALIENT OBJECT DETECTION
    Sun, Fengming
    Zhang, Kang
    Yuan, Xia
    Zhao, Chunxia
    2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 1300 - 1304
  • [28] Learning a Twofold Siamese Network for RGB-T Object Tracking
    Kuai, Yangliu
    Li, Dongdong
    Qian, Que
    JOURNAL OF CIRCUITS SYSTEMS AND COMPUTERS, 2021, 30 (05)
  • [29] RGB-T Salient Object Detection via Fusing Multi-Level CNN Features
    Zhang, Qiang
    Huang, Nianchang
    Yao, Lin
    Zhang, Dingwen
    Shan, Caifeng
    Han, Jungong
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 3321 - 3335
  • [30] Revisiting Feature Fusion for RGB-T Salient Object Detection
    Zhang, Qiang
    Xiao, Tonglin
    Huang, Nianchang
    Zhang, Dingwen
    Han, Jungong
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2021, 31 (05) : 1804 - 1818