Deep OCT image compression with convolutional neural networks

被引:14
|
作者
Guo, Pengfei [1 ]
Li, Dawei [2 ]
Li, Xingde [2 ,3 ]
机构
[1] Johns Hopkins Univ, Dept Comp Sci, Baltimore, MD 21218 USA
[2] Johns Hopkins Univ, Dept Biomed Engn, Baltimore, MD 21205 USA
[3] Johns Hopkins Univ, Dept Elect & Comp Engn, Baltimore, MD 21218 USA
来源
BIOMEDICAL OPTICS EXPRESS | 2020年 / 11卷 / 07期
基金
美国国家卫生研究院;
关键词
RETINAL LAYER; SEGMENTATION;
D O I
10.1364/BOE.392882
中图分类号
Q5 [生物化学];
学科分类号
071010 ; 081704 ;
摘要
We report an end-to-end image compression framework for retina optical coherence tomography (OCT) images based on convolutional neural networks (CNNs), which achieved an image size compression ratio as high as 80. Our compression scheme consists of three parts: data preprocessing, compression CNNs, and reconstruction CNNs. The preprocessing module was designed to reduce OCT speckle noise and segment out the region of interest. Skip connections with quantization were developed and added between the compression CNNs and the reconstruction CNNs to reserve the fine-structure information. Two networks were trained together by taking the semantic segmented images from the preprocessing module as input. To train the two networks sensitive to both low and high frequency information, we leveraged an objective function with two components: an adversarial discriminator to judge the high frequency information and a differentiable multi-scale structural similarity (MS-SSIM) penalty to evaluate the low frequency information. The proposed framework was trained and evaluated on ophthalmic OCT images with pathological information. The evaluation showed reconstructed images can still achieve above 99% similarity in terms of MS-SSIM when the compression ratio reached 40. Furthermore, the reconstructed images after 80-fold compression with the proposed framework even presented comparable quality with those of a compression ratio 20 from state-of-the-art methods. The test results showed that the proposed framework outperformed other methods in terms of both MS-SSIM and visualization, which was more obvious at higher compression ratios. Compression and reconstruction were fast and took only about 0.015 seconds per image. The results suggested a promising potential of deep neural networks on customized medical image compression, particularly valuable for effective image storage and tele-transfer. (C) 2020 Optical Society of America under the terms of the OSA Open Access Publishing Agreement.
引用
收藏
页码:3543 / 3554
页数:12
相关论文
共 50 条
  • [1] Iris Image Compression Using Deep Convolutional Neural Networks
    Jalilian, Ehsaneddin
    Hofbauer, Heinz
    Uhl, Andreas
    [J]. SENSORS, 2022, 22 (07)
  • [2] Deep convolutional neural networks for automated OCT pathology recognition
    Russakoff, Daniel B.
    Oakley, Jonathan D.
    Chang, Robert
    [J]. INVESTIGATIVE OPHTHALMOLOGY & VISUAL SCIENCE, 2017, 58 (08)
  • [3] Linear Regularized Compression of Deep Convolutional Neural Networks
    Ceruti, Claudio
    Campadelli, Paola
    Casiraghi, Elena
    [J]. IMAGE ANALYSIS AND PROCESSING,(ICIAP 2017), PT I, 2017, 10484 : 244 - 253
  • [4] Fast and Robust Compression of Deep Convolutional Neural Networks
    Wen, Jia
    Yang, Liu
    Shen, Chenyang
    [J]. ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2020, PT II, 2020, 12397 : 52 - 63
  • [5] Multiple Description Convolutional Neural Networks for Image Compression
    Zhao, Lijun
    Bai, Huihui
    Wang, Anhong
    Zhao, Yao
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2019, 29 (08) : 2494 - 2508
  • [6] DEEP CONVOLUTIONAL NEURAL NETWORKS FEATURES FOR IMAGE RETRIEVAL
    Kanaparthi, Suresh kumar
    Raju, U. S. N.
    [J]. ADVANCES AND APPLICATIONS IN MATHEMATICAL SCIENCES, 2021, 20 (11): : 2613 - 2626
  • [7] Histopathological Image Classification with Deep Convolutional Neural Networks
    Alom, Md Zahangir
    Aspiras, Theus
    Taha, Tarek M.
    Asari, Vijayan K.
    [J]. APPLICATIONS OF MACHINE LEARNING, 2019, 11139
  • [8] Evolving Deep Convolutional Neural Networks for Image Classification
    Sun, Yanan
    Xue, Bing
    Zhang, Mengjie
    Yen, Gary G.
    [J]. IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2020, 24 (02) : 394 - 407
  • [9] Robustness of Deep Convolutional Neural Networks for Image Recognition
    Ulicny, Matej
    Lundstrom, Jens
    Byttner, Stefan
    [J]. INTELLIGENT COMPUTING SYSTEMS, 2016, 597 : 16 - 30
  • [10] ROBUSTNESS OF DEEP CONVOLUTIONAL NEURAL NETWORKS FOR IMAGE DEGRADATIONS
    Ghosh, Sanjukta
    Shet, Rohan
    Amon, Peter
    Hutter, Andreas
    Kaup, Andre
    [J]. 2018 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2018, : 2916 - 2920