Low-light image enhancement of high-speed endoscopic videos using a convolutional neural network

被引:36
|
作者
Gomez, Pablo [1 ]
Semmler, Marion [1 ]
Schuetzenberger, Anne [1 ]
Bohr, Christopher [2 ]
Doellinger, Michael [1 ]
机构
[1] Friedrich Alexander Univ Erlangen Nurnberg, Univ Hosp Erlangen, Div Phoniatr & Pediat Audiol, Dept Otorhinolaryngol Head & Neck Surg, Waldstr 1, D-91054 Erlangen, Germany
[2] Univ Regensburg, Univ Hosp Regensburg, ENT Dept, Franz Josef Str Allee 11, D-93053 Regensburg, Germany
关键词
Convolutional neural network; Endoscopy; High-speed video; Image enhancement; Image processing; VOCAL FOLD VIBRATIONS; QUALITY ASSESSMENT; VOICE ASSESSMENT; REAL-TIME; RECONSTRUCTION; PREVALENCE;
D O I
10.1007/s11517-019-01965-4
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Laryngeal endoscopy is one of the primary diagnostic tools for laryngeal disorders. The main techniques are videostroboscopy and lately high-speed video endoscopy. Unfortunately, due to the restricting anatomy of the larynx and technical limitations of the recording equipment, many videos suffer from insufficient illumination, which complicates clinical examination and analysis. This work presents an approach to enhance low-light images from high-speed video endoscopy using a convolutional neural network. We introduce a new technique to generate realistically darkened training samples using Perlin noise. Extensive data augmentation is employed to cope with the limited training data allowing training with just 55 videos. The approach is compared against four state-of-the-art low-light enhancement methods and statistically significantly outperforms each on a no-reference (NIQE) and two full-reference (PSNR, SSIM) image quality metrics. The presented approach can be run on consumer-grade hardware and is thereby directly applicable in a clinical context. It is likely transferable to similar techniques such as videostroboscopy.
引用
收藏
页码:1451 / 1463
页数:13
相关论文
共 50 条
  • [1] Low-light image enhancement of high-speed endoscopic videos using a convolutional neural network
    Pablo Gómez
    Marion Semmler
    Anne Schützenberger
    Christopher Bohr
    Michael Döllinger
    [J]. Medical & Biological Engineering & Computing, 2019, 57 : 1451 - 1463
  • [2] LLCNN: A Convolutional Neural Network for Low-light Image Enhancement
    Tao, Li
    Zhu, Chuang
    Xiang, Guoqing
    Li, Yuan
    Jia, Huizhu
    Xie, Xiaodong
    [J]. 2017 IEEE VISUAL COMMUNICATIONS AND IMAGE PROCESSING (VCIP), 2017,
  • [3] Low-Light Image Enhancement Based on Deep Convolutional Neural Network
    Ma Hongqiang
    Ma Shiping
    Xu Yuelei
    Zhu Mingming
    [J]. ACTA OPTICA SINICA, 2019, 39 (02)
  • [4] Low-Light Image Enhancement Based on Deep Convolutional Neural Network
    Ma H.
    Ma S.
    Xu Y.
    Zhu M.
    [J]. Guangxue Xuebao/Acta Optica Sinica, 2019, 39 (02):
  • [5] Low-Light Image Enhancement by Combining Transformer and Convolutional Neural Network
    Yuan, Nianzeng
    Zhao, Xingyun
    Sun, Bangyong
    Han, Wenjia
    Tan, Jiahai
    Duan, Tao
    Gao, Xiaomei
    [J]. MATHEMATICS, 2023, 11 (07)
  • [6] Low-Light Image Restoration Using a Convolutional Neural Network
    Hussain, Syed Ali
    Chalicham, Nandini
    Garine, Likhita
    Chunduru, Shushma
    Nikitha, V. N. V. S. L.
    Prasad V, P. N. S. B. S. V.
    Sanki, Pradyut Kumar
    [J]. JOURNAL OF ELECTRONIC MATERIALS, 2024, 53 (07) : 3582 - 3593
  • [7] Low-Light Image Restoration Using a Convolutional Neural Network
    Hussain, Syed Ali
    Chalicham, Nandini
    Garine, Likhita
    Chunduru, Shushma
    Nikitha, V. N. V. S. L.
    Prasad, P. N. S. B. S., V
    Sanki, Pradyut Kumar
    [J]. JOURNAL OF ELECTRONIC MATERIALS, 2024,
  • [8] LOW-LIGHT IMAGE ENHANCEMENT USING ASYMMETRIC CONVOLUTIONAL NEURAL NETWORKS
    Liu, Jiajia
    Deng, Zhixiang
    [J]. INTERNATIONAL JOURNAL OF INNOVATIVE COMPUTING INFORMATION AND CONTROL, 2024, 20 (02): : 479 - 496
  • [9] Improvement of Low-Light Image by Convolutional Neural Network
    Kim, Manbae
    [J]. 2019 IEEE 62ND INTERNATIONAL MIDWEST SYMPOSIUM ON CIRCUITS AND SYSTEMS (MWSCAS), 2019, : 189 - 192
  • [10] A Deep Convolutional Neural Network-based Low-light Image Enhancement Using Illumination Map
    Wang, Liqian
    Shao, Wenze
    Ge, Qi
    [J]. ELEVENTH INTERNATIONAL CONFERENCE ON GRAPHICS AND IMAGE PROCESSING (ICGIP 2019), 2020, 11373