MU-Net: Deep Learning-based Thermal IR Image Estimation from RGB Image

被引:6
|
作者
Iwashita, Yumi [1 ]
Nakashima, Kazuto [2 ]
Rata, Sir [1 ]
Stoica, Adrian [1 ]
Kurazume, Ryo [2 ]
机构
[1] CALTECH, Jet Prop Lab, Pasadena, CA 91125 USA
[2] Kyushu Univ, Fukuoka, Japan
关键词
D O I
10.1109/CVPRW.2019.00134
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Terrain imagery collected by satellite remote sensing or by raver on-board sensors is the primary source for terrain classification used in determining terrain traversibility and mission plans for planetary rovers. Mapping models between RGB and IR for terrain classes are learned from real RGB and IR data examples in the same or similar terrain. This paper adds a new class of deep learning architectures called MU-Net (Multiple U-Net) and shows its efficiency in deriving better RGB-to-IR mapping models, improving over past work the estimation of thermal IR images from incoming RGB images and learned RGB-IR mappings.(1)
引用
收藏
页码:1022 / 1028
页数:7
相关论文
共 50 条
  • [1] Deep learning-based RGB-thermal image denoising: review and applications
    Yu, Yuan
    Lee, Boon Giin
    Pike, Matthew
    Zhang, Qian
    Chung, Wan-Young
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (04) : 11613 - 11641
  • [2] Deep learning-based RGB-thermal image denoising: review and applications
    Yuan Yu
    Boon Giin Lee
    Matthew Pike
    Qian Zhang
    Wan-Young Chung
    [J]. Multimedia Tools and Applications, 2024, 83 : 11613 - 11641
  • [3] BP-net: deep learning-based superpixel segmentation for RGB-D image
    Zhang, Bin
    Kang, Xuejing
    Ming, Anlong
    [J]. 2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 7433 - 7438
  • [4] Deep Learning-based Thermal Infrared Image Deblurring
    Chien Thai
    Huong Ninh
    Hai Tran
    [J]. ELECTRO-OPTICAL AND INFRARED SYSTEMS: TECHNOLOGY AND APPLICATIONS XIX, 2022, 12271
  • [5] Deep learning for thermal-RGB image-to-image translation
    Wadsworth, Emma
    Mahajan, Advait
    Prasad, Raksha
    Menon, Rajesh
    [J]. INFRARED PHYSICS & TECHNOLOGY, 2024, 141
  • [6] MU-Net: A MULTISCALE UNSUPERVISED NETWORK FOR REMOTE SENSING IMAGE REGISTRATION
    Tang, Tengfeng
    Chen, Tingting
    Zhu, Bai
    Ye, Yuanxin
    [J]. XXIV ISPRS CONGRESS: IMAGING TODAY, FORESEEING TOMORROW, COMMISSION III, 2022, 43-B3 : 537 - 544
  • [7] Research of Deep Learning-Based Computational Spectral Imaging for Single RGB Image
    Jiang, Zhongmin
    Zhang, Wanyan
    Wang, Wenju
    [J]. Computer Engineering and Applications, 2023, 59 (10) : 22 - 34
  • [8] Phenotypic Parameters Estimation of Plants Using Deep Learning-Based 3-D Reconstruction From Single RGB Image
    Zhao, Genping
    Cai, Weitao
    Wang, Zhuowei
    Wu, Heng
    Peng, Yeping
    Cheng, Lianglun
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [9] Deep Learning-Based Thermal Image Reconstruction and Object Detection
    Batchuluun, Ganbayar
    Kang, Jin Kyu
    Nguyen, Dat Tien
    Pham, Tuyen Danh
    Arsalan, Muhammad
    Park, Kang Ryoung
    [J]. IEEE ACCESS, 2021, 9 : 5951 - 5971
  • [10] Deep Learning-based Depth Estimation from a Synthetic Endoscopy Image Training Set
    Mahmood, Faisal
    Durr, Nicholas J.
    [J]. MEDICAL IMAGING 2018: IMAGE PROCESSING, 2018, 10574