RGB-T Image Saliency Detection via Collaborative Graph Learning

被引:154
|
作者
Tu, Zhengzheng [1 ]
Xia, Tian [1 ]
Li, Chenglong [1 ,2 ]
Wang, Xiaoxiao [1 ]
Ma, Yan [1 ]
Tang, Jin [1 ]
机构
[1] Anhui Univ, Sch Comp Sci & Technol, Minist Educ, Key Lab Intelligent Comp & Signal Proc, Hefei 230601, Peoples R China
[2] Anhui Univ, Inst Phys Sci & Informat Technol, Hefei 230601, Peoples R China
关键词
Image saliency detection; RGB-thermal fusion; Collaborative graph; Joint optimization; Benchmark dataset; OBJECT DETECTION;
D O I
10.1109/TMM.2019.2924578
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Image saliency detection is an active research topic in the community of computer vision and multimedia. Fusing complementary RGB and thermal infrared data has been proven to be effective for image saliency detection. In this paper, we propose an effective approach for RGB-T image saliency detection. Our approach relies on a novel collaborative graph learning algorithm. In particular, we take superpixels as graph nodes, and collaboratively use hierarchical deep features to jointly learn graph affinity and node saliency in a unified optimization framework. Moreover, we contribute a more challenging dataset for the purpose of RGB-T image saliency detection, which contains 1000 spatially aligned RGB-T image pairs and their ground truth annotations. Extensive experiments on the public dataset and the newly created dataset suggest that the proposed approach performs favorably against the state-of-the-art RGB-T saliency detection methods.
引用
收藏
页码:160 / 173
页数:14
相关论文
共 50 条
  • [1] RGB-T Saliency Detection via Low-Rank Tensor Learning and Unified Collaborative Ranking
    Huang, Liming
    Song, Kechen
    Gong, Aojun
    Liu, Chuang
    Yan, Yunhui
    IEEE SIGNAL PROCESSING LETTERS, 2020, 27 : 1585 - 1589
  • [2] Learning Static-Adaptive Graphs for RGB-T Image Saliency Detection
    Xu, Zhengmei
    Tang, Jin
    Zhou, Aiwu
    Liu, Huaming
    INFORMATION, 2022, 13 (02)
  • [3] Cross-modal collaborative propagation for RGB-T saliency detection
    Yu, Xiaosheng
    Pang, Yu
    Chi, Jianning
    Qi, Qi
    VISUAL COMPUTER, 2024, 40 (06): : 4337 - 4354
  • [4] Unsupervised RGB-T saliency detection by node classification distance and sparse constrained graph learning
    Aojun Gong
    Liming Huang
    Jiashun Shi
    Chuang Liu
    Applied Intelligence, 2022, 52 : 1030 - 1043
  • [5] Unsupervised RGB-T saliency detection by node classification distance and sparse constrained graph learning
    Gong, Aojun
    Huang, Liming
    Shi, Jiashun
    Liu, Chuang
    APPLIED INTELLIGENCE, 2022, 52 (01) : 1030 - 1043
  • [6] Saliency Prototype for RGB-D and RGB-T Salient Object Detection
    Zhang, Zihao
    Wang, Jie
    Han, Yahong
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 3696 - 3705
  • [7] Learning Multiscale Deep Features and SVM Regressors for Adaptive RGB-T Saliency Detection
    Ma, Yunpeng
    Sun, Dengdi
    Meng, Qianqian
    Ding, Zhuanlian
    Li, Chenglong
    2017 10TH INTERNATIONAL SYMPOSIUM ON COMPUTATIONAL INTELLIGENCE AND DESIGN (ISCID), VOL. 1, 2017, : 389 - 392
  • [8] RGB-T Saliency Detection Based on Multiscale Modal Reasoning Interaction
    Wu, Yunhe
    Jia, Tong
    Chang, Xingya
    Wang, Hao
    Chen, Dongyue
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2024, 73
  • [9] RGB-T salient object detection via CNN feature and result saliency map fusion
    Chang Xu
    Qingwu Li
    Mingyu Zhou
    Qingkai Zhou
    Yaqin Zhou
    Yunpeng Ma
    Applied Intelligence, 2022, 52 : 11343 - 11362
  • [10] RGB-T salient object detection via CNN feature and result saliency map fusion
    Xu, Chang
    Li, Qingwu
    Zhou, Mingyu
    Zhou, Qingkai
    Zhou, Yaqin
    Ma, Yunpeng
    APPLIED INTELLIGENCE, 2022, 52 (10) : 11343 - 11362