Single patch super-resolution of histopathology whole slide images: a comparative study

被引:3
|
作者
Afshari, Mehdi [1 ]
Yasir, Saba [2 ]
Keeney, Gary L. [2 ]
Jimenez, Rafael E. [2 ]
Garcia, Joaquin J. [2 ]
Tizhoosh, Hamid R. [1 ,3 ]
机构
[1] Univ Waterloo, Kimia Lab, Waterloo, ON, Canada
[2] Mayo Clin, Anat Pathol, Rochester, MN USA
[3] Mayo Clin, Artificial Intelligence & Informat, Rochester, MN 55905 USA
关键词
histopathology; super-resolution; deep neural networks; generative adversarial networks; NETWORKS;
D O I
10.1117/1.JMI.10.1.017501
中图分类号
R8 [特种医学]; R445 [影像诊断学];
学科分类号
1002 ; 100207 ; 1009 ;
摘要
Purpose: The latest generation of scanners can digitize histopathology glass slides for computerized image analysis. These images contain valuable information for diagnostic and prognostic purposes. Consequently, the availability of high digital magnifications like 20x and 40x is commonly expected in scanning the slides. Thus, the image acquisition typically generates gigapixel high-resolution images, times as large as 100,000 x 100,000 pixels. Naturally, the storage and processing of such huge files may be subject to severe computational bottlenecks. As a result, the need for techniques that can operate on lower magnification levels but produce results on par with outcomes for high magnification levels is becoming urgent. Approach: Over the past decade, the digital solution of enhancing images resolution has been addressed by the concept of super resolution (SR). In addition, deep learning has offered state-ofthe-art results for increasing the image resolution after acquisition. In this study, multiple deep learning networks designed for image SR are trained and assessed for the histopathology domain. Results: We report quantitative and qualitative comparisons of the results using publicly available cancer images to shed light on the benefits and challenges of deep learning for extrapolating image resolution in histopathology. Three pathologists evaluated the results to assess the quality and diagnostic value of generated SR images. Conclusions: Pixel-level information, including structures and textures in histopathology images, are learnable by deep networks; hence improving the resolution quantity of scanned slides is possible by training appropriate networks. Different SR networks may perform best for various cancer sites and subtypes.
引用
收藏
页数:17
相关论文
共 50 条
  • [1] Joint Super-resolution and Tissue Patch Classification for Whole Slide Histological Images
    Sun, Zh.
    Khvostikov, A.
    Krylov, A.
    Sethi, A.
    Mikhailov, I.
    Malkov, P.
    [J]. PROGRAMMING AND COMPUTER SOFTWARE, 2024, 50 (03) : 257 - 263
  • [2] Comparative study on super-resolution of images
    Ibrahim, I. I.
    Ahmed, M. K.
    Nossair, Z. B.
    Allam, F. A.
    [J]. 2006 INTERNATIONAL CONFERENCE ON COMPUTER ENGINEERING & SYSTEMS, 2006, : 220 - +
  • [3] Unsupervised super-resolution reconstruction of hyperspectral histology images for whole-slide imaging
    Ma, Ling
    Rathgeb, Armand
    Mubarak, Hasan
    Tran, Minh
    Fei, Baowei
    [J]. JOURNAL OF BIOMEDICAL OPTICS, 2022, 27 (05)
  • [4] Super-resolution recurrent convolutional neural networks for learning with multi-resolution whole slide images
    Mukherjee, Lopamudra
    Bui, Huu Dat
    Keikhosravi, Adib
    Loeffler, Agnes
    Eliceiri, Kevin W.
    [J]. JOURNAL OF BIOMEDICAL OPTICS, 2019, 24 (12)
  • [5] Patch Transformer for Multi-tagging Whole Slide Histopathology Images
    Li, Weijian
    Viet-Duy Nguyen
    Liao, Haofu
    Wilder, Matt
    Cheng, Ke
    Luo, Jiebo
    [J]. MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2019, PT I, 2019, 11764 : 532 - 540
  • [6] PATCH BASED SUPER-RESOLUTION OF MR SPECTROSCOPIC IMAGES
    Jain, S.
    Sima, D. M.
    Nezhad, F. Sanaei
    Williams, S.
    Van Huffel, S.
    Maes, F.
    Smeets, D.
    [J]. 2016 IEEE 13TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI), 2016, : 452 - 456
  • [7] Fast and simple super-resolution with single images
    Paul H. C. Eilers
    Cyril Ruckebusch
    [J]. Scientific Reports, 12
  • [8] Fast and simple super-resolution with single images
    Eilers, Paul H. C.
    Ruckebusch, Cyril
    [J]. SCIENTIFIC REPORTS, 2022, 12 (01)
  • [9] Single image super-resolution based on image patch classification
    Xia, Ping
    Yan, Hua
    Li, Jing
    Sun, Jiande
    [J]. SECOND INTERNATIONAL WORKSHOP ON PATTERN RECOGNITION, 2017, 10443
  • [10] Adaptive Patch Exiting for Scalable Single Image Super-Resolution
    Wang, Shizun
    Liu, Jiaming
    Chen, Kaixin
    Li, Xiaoqi
    Lu, Ming
    Guo, Yandong
    [J]. COMPUTER VISION - ECCV 2022, PT XVIII, 2022, 13678 : 292 - 307