Single patch super-resolution of histopathology whole slide images: a comparative study

被引:3
|
作者
Afshari, Mehdi [1 ]
Yasir, Saba [2 ]
Keeney, Gary L. [2 ]
Jimenez, Rafael E. [2 ]
Garcia, Joaquin J. [2 ]
Tizhoosh, Hamid R. [1 ,3 ]
机构
[1] Univ Waterloo, Kimia Lab, Waterloo, ON, Canada
[2] Mayo Clin, Anat Pathol, Rochester, MN USA
[3] Mayo Clin, Artificial Intelligence & Informat, Rochester, MN 55905 USA
关键词
histopathology; super-resolution; deep neural networks; generative adversarial networks; NETWORKS;
D O I
10.1117/1.JMI.10.1.017501
中图分类号
R8 [特种医学]; R445 [影像诊断学];
学科分类号
1002 ; 100207 ; 1009 ;
摘要
Purpose: The latest generation of scanners can digitize histopathology glass slides for computerized image analysis. These images contain valuable information for diagnostic and prognostic purposes. Consequently, the availability of high digital magnifications like 20x and 40x is commonly expected in scanning the slides. Thus, the image acquisition typically generates gigapixel high-resolution images, times as large as 100,000 x 100,000 pixels. Naturally, the storage and processing of such huge files may be subject to severe computational bottlenecks. As a result, the need for techniques that can operate on lower magnification levels but produce results on par with outcomes for high magnification levels is becoming urgent. Approach: Over the past decade, the digital solution of enhancing images resolution has been addressed by the concept of super resolution (SR). In addition, deep learning has offered state-ofthe-art results for increasing the image resolution after acquisition. In this study, multiple deep learning networks designed for image SR are trained and assessed for the histopathology domain. Results: We report quantitative and qualitative comparisons of the results using publicly available cancer images to shed light on the benefits and challenges of deep learning for extrapolating image resolution in histopathology. Three pathologists evaluated the results to assess the quality and diagnostic value of generated SR images. Conclusions: Pixel-level information, including structures and textures in histopathology images, are learnable by deep networks; hence improving the resolution quantity of scanned slides is possible by training appropriate networks. Different SR networks may perform best for various cancer sites and subtypes.
引用
收藏
页数:17
相关论文
共 50 条
  • [31] Super-resolution on Remote Sensing Images
    Yang, Yuting
    Lam, Kin-Man
    Dong, Junyu
    Sun, Xin
    Jian, Muwei
    [J]. INTERNATIONAL WORKSHOP ON ADVANCED IMAGING TECHNOLOGY (IWAIT) 2021, 2021, 11766
  • [32] Robust Dual Images Super-resolution
    Zhang, Xiaohong
    Zhang, Yun
    Qian, Guiping
    Qin, Aihong
    [J]. 2018 11TH INTERNATIONAL CONGRESS ON IMAGE AND SIGNAL PROCESSING, BIOMEDICAL ENGINEERING AND INFORMATICS (CISP-BMEI 2018), 2018,
  • [33] Super-resolution of Defocus Blurred Images
    Seyyedyazdi, S.J.
    Hassanpour, H.
    [J]. International Journal of Engineering, Transactions A: Basics, 2020, 33 (04): : 539 - 545
  • [34] Super-resolution algorithms for SAR images
    Guglielmi, V
    Castanie, F
    Piau, P
    [J]. IMAGE RECONSTRUCTION AND RESTORATION II, 1997, 3170 : 195 - 202
  • [35] Single Image Super-Resolution by Clustered Sparse Representation and Adaptive Patch Aggregation
    Huang Wei
    Xiao Liang
    Wei Zhihui
    Fei Xuan
    Wang Kai
    [J]. CHINA COMMUNICATIONS, 2013, 10 (05) : 50 - 61
  • [36] Patch-based super-resolution of arterial spin labeling magnetic resonance images
    Meuree, Cedric
    Maurel, Pierre
    Ferre, Jean-Christophe
    Barillot, Christian
    [J]. NEUROIMAGE, 2019, 189 : 85 - 94
  • [37] Super-resolution for in situ Plankton Images
    Ma, Wenqi
    Chen, Tao
    Zhang, Zhengwen
    Yang, Zhenyu
    Dong, Chao
    Qiao, Jianping
    Li, Jianping
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2021), 2021, : 3676 - 3685
  • [38] Super-resolution of Defocus Blurred Images
    Seyyedyazdi, S. J.
    Hassanpour, H.
    [J]. INTERNATIONAL JOURNAL OF ENGINEERING, 2020, 33 (04): : 539 - 545
  • [39] Super-resolution reconstruction of hyperspectral images
    Akgun, T
    Altunbasak, Y
    Mersereau, RM
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2005, 14 (11) : 1860 - 1875
  • [40] Patch-Based Super-Resolution of MR Spectroscopic Images: Application to Multiple Sclerosis
    Jain, Saurabh
    Sima, Diana M.
    Nezhad, Faezeh Sanaei
    Hangel, Gilbert
    Bogner, Wolfgang
    Williams, Stephen
    Van Huffel, Sabine
    Maes, Frederik
    Smeets, Dirk
    [J]. FRONTIERS IN NEUROSCIENCE, 2017, 11