Meta transfer learning-based super-resolution infrared imaging

被引:5
|
作者
Wu, Wenhao [1 ,2 ]
Wang, Tao [1 ,2 ]
Wang, Zhuowei [1 ,2 ]
Cheng, Lianglun [1 ,2 ]
Wu, Heng [1 ,2 ]
机构
[1] Guangdong Univ Technol, Sch Automat, Guangdong Prov Key Lab Cyber Phys Syst, Guangzhou 510006, Guangdong, Peoples R China
[2] Guangdong Univ Technol, Sch Comp, Guangzhou 510006, Guangdong, Peoples R China
基金
中国国家自然科学基金;
关键词
Super-resolution; Deep learning; Meta-learning; Internal learning; Infrared image;
D O I
10.1016/j.dsp.2022.103730
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
We propose an infrared image super-resolution method with meta-transfer learning and a lightweight network. We design a lightweight network to learn the map between low-resolution and high-resolution infrared images. We train the network with an external dataset and use meta-transfer learning with an internal dataset that makes the network drop to a sensitive and transferable point. We build an infrared imaging system with an infrared module. The designed network is implemented on a personal computer and the SR image is reconstructed by the trained network. The main contribution of this paper is to adopt a lightweight network and meta-transfer learning method, which obtains infrared super-resolution images with better visual effects. Both numerical and experimental results show that the proposed method achieves the infrared image super-resolution, and the performance of the proposed method is superior to four state-of-art image super-resolution methods. The proposed method has practical application in the image super-resolution of mobile infrared devices. (c) 2022 Published by Elsevier Inc.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] Deep learning-based image super-resolution restoration for mobile infrared imaging system
    Wu, Heng
    Hao, Xinyue
    Wu, Jibiao
    Xiao, Huapan
    He, Chunhua
    Yin, Shenxin
    [J]. INFRARED PHYSICS & TECHNOLOGY, 2023, 132
  • [2] Deep learning-based infrared imaging degradation model identification and super-resolution reconstruction
    Cao, Junfeng
    Ding, Qinghai
    Zou, Depeng
    Qin, Hengjia
    Luo, Haibo
    [J]. Hongwai yu Jiguang Gongcheng/Infrared and Laser Engineering, 2024, 53 (05):
  • [3] Deep learning-based super-resolution in coherent imaging systems
    Liu, Tairan
    de Haan, Kevin
    Rivenson, Yair
    Wei, Zhensong
    Zeng, Xin
    Zhang, Yibo
    Ozcan, Aydogan
    [J]. SCIENTIFIC REPORTS, 2019, 9 (1)
  • [4] Deep learning-based super-resolution in coherent imaging systems
    Tairan Liu
    Kevin de Haan
    Yair Rivenson
    Zhensong Wei
    Xin Zeng
    Yibo Zhang
    Aydogan Ozcan
    [J]. Scientific Reports, 9
  • [5] ROBUST LEARNING-BASED SUPER-RESOLUTION
    Kim, Changhyun
    Choi, Kyuha
    Lee, Ho-young
    Hwang, Kyuyoung
    Ra, Jong Beom
    [J]. 2010 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, 2010, : 2017 - 2020
  • [6] Limitations of Learning-Based Super-Resolution
    Shoji, Hiroki
    Gohshi, Seiichi
    [J]. 2015 INTERNATIONAL SYMPOSIUM ON INTELLIGENT SIGNAL PROCESSING AND COMMUNICATION SYSTEMS (ISPACS), 2015, : 646 - 651
  • [7] Super-sampling by learning-based super-resolution
    Du, Ping
    Zhang, Jinhuan
    Long, Jun
    [J]. INTERNATIONAL JOURNAL OF COMPUTATIONAL SCIENCE AND ENGINEERING, 2020, 21 (02) : 249 - 257
  • [8] Deep learning-based point-scanning super-resolution imaging
    Fang, Linjing
    Monroe, Fred
    Novak, Sammy Weiser
    Kirk, Lyndsey
    Schiavon, Cara R.
    Yu, Seungyoon B.
    Zhang, Tong
    Wu, Melissa
    Kastner, Kyle
    Latif, Alaa Abdel
    Lin, Zijun
    Shaw, Andrew
    Kubota, Yoshiyuki
    Mendenhall, John
    Zhang, Zhao
    Pekkurnaz, Gulcin
    Harris, Kristen
    Howard, Jeremy
    Manor, Uri
    [J]. NATURE METHODS, 2021, 18 (04) : 406 - +
  • [9] Deep learning-based point-scanning super-resolution imaging
    Linjing Fang
    Fred Monroe
    Sammy Weiser Novak
    Lyndsey Kirk
    Cara R. Schiavon
    Seungyoon B. Yu
    Tong Zhang
    Melissa Wu
    Kyle Kastner
    Alaa Abdel Latif
    Zijun Lin
    Andrew Shaw
    Yoshiyuki Kubota
    John Mendenhall
    Zhao Zhang
    Gulcin Pekkurnaz
    Kristen Harris
    Jeremy Howard
    Uri Manor
    [J]. Nature Methods, 2021, 18 : 406 - 416
  • [10] Deep Learning-Based Point-Scanning Super-Resolution Imaging
    Manor, Uri
    Fang, Linjing
    Howard, Jeremy
    Monroe, Fred
    Weiser, Sammy
    Kastner, Kyle
    Kirk, Lyndsey
    Harris, Kristen
    Pekkurnaz, Gulcin
    Yoon, Blenda
    Schiavon, Cara
    Zhang, Tong
    [J]. FASEB JOURNAL, 2020, 34