Single patch super-resolution of histopathology whole slide images: a comparative study

被引:3
|
作者
Afshari, Mehdi [1 ]
Yasir, Saba [2 ]
Keeney, Gary L. [2 ]
Jimenez, Rafael E. [2 ]
Garcia, Joaquin J. [2 ]
Tizhoosh, Hamid R. [1 ,3 ]
机构
[1] Univ Waterloo, Kimia Lab, Waterloo, ON, Canada
[2] Mayo Clin, Anat Pathol, Rochester, MN USA
[3] Mayo Clin, Artificial Intelligence & Informat, Rochester, MN 55905 USA
关键词
histopathology; super-resolution; deep neural networks; generative adversarial networks; NETWORKS;
D O I
10.1117/1.JMI.10.1.017501
中图分类号
R8 [特种医学]; R445 [影像诊断学];
学科分类号
1002 ; 100207 ; 1009 ;
摘要
Purpose: The latest generation of scanners can digitize histopathology glass slides for computerized image analysis. These images contain valuable information for diagnostic and prognostic purposes. Consequently, the availability of high digital magnifications like 20x and 40x is commonly expected in scanning the slides. Thus, the image acquisition typically generates gigapixel high-resolution images, times as large as 100,000 x 100,000 pixels. Naturally, the storage and processing of such huge files may be subject to severe computational bottlenecks. As a result, the need for techniques that can operate on lower magnification levels but produce results on par with outcomes for high magnification levels is becoming urgent. Approach: Over the past decade, the digital solution of enhancing images resolution has been addressed by the concept of super resolution (SR). In addition, deep learning has offered state-ofthe-art results for increasing the image resolution after acquisition. In this study, multiple deep learning networks designed for image SR are trained and assessed for the histopathology domain. Results: We report quantitative and qualitative comparisons of the results using publicly available cancer images to shed light on the benefits and challenges of deep learning for extrapolating image resolution in histopathology. Three pathologists evaluated the results to assess the quality and diagnostic value of generated SR images. Conclusions: Pixel-level information, including structures and textures in histopathology images, are learnable by deep networks; hence improving the resolution quantity of scanned slides is possible by training appropriate networks. Different SR networks may perform best for various cancer sites and subtypes.
引用
收藏
页数:17
相关论文
共 50 条
  • [41] Local patch encoding-based method for single image super-resolution
    Zhao, Yang
    Wang, Ronggang
    Jia, Wei
    Yang, Jianchao
    Wang, Wenmin
    Gao, Wen
    [J]. INFORMATION SCIENCES, 2018, 433 : 292 - 305
  • [42] Resolution-agnostic tissue segmentation in whole-slide histopathology images with convolutional neural networks
    Bandi, Peter
    Balkenhol, Maschenka
    van Ginneken, Bram
    van der Laak, Jeroen
    Litjens, Geert
    [J]. PEERJ, 2019, 7
  • [43] Deep Super-Resolution Network for Single Image Super-Resolution with Realistic Degradations
    Umer, Rao Muhammad
    Foresti, Gian Luca
    Micheloni, Christian
    [J]. ICDSC 2019: 13TH INTERNATIONAL CONFERENCE ON DISTRIBUTED SMART CAMERAS, 2019,
  • [44] A compendious study of super-resolution techniques by single image
    Pandey, Garima
    Ghanekar, Umesh
    [J]. OPTIK, 2018, 166 : 147 - 160
  • [45] Single Image Super-Resolution Technique using Precision learning of Low Resolution Images
    Salam, Amritha Abdul
    Mahadevappa, Manjunatha
    [J]. PROCEEDINGS OF THE 2019 IEEE REGION 10 CONFERENCE (TENCON 2019): TECHNOLOGY, KNOWLEDGE, AND SOCIETY, 2019, : 306 - 310
  • [46] Comparative analysis of methods of super-resolution
    Terentiev, EN
    Terentiev, NE
    [J]. VISUAL INFORMATION PROCESSING X, 2001, 4388 : 200 - 209
  • [47] Comparative analysis of super-resolution reconstructed images for micro-expression recognition
    Pratikshya Sharma
    Sonya Coleman
    Pratheepan Yogarajah
    Laurence Taggart
    Pradeepa Samarasinghe
    [J]. Advances in Computational Intelligence, 2022, 2 (3):
  • [48] Super-Resolution by Predicting Offsets: An Ultra-Efficient Super-Resolution Network for Rasterized Images
    Gu, Jinjin
    Cai, Haoming
    Dong, Chenyu
    Zhang, Ruofan
    Zhang, Yulun
    Yang, Wenming
    Yuan, Chun
    [J]. COMPUTER VISION, ECCV 2022, PT XIX, 2022, 13679 : 583 - 598
  • [49] Axial plane single-molecule super-resolution microscopy of whole cells
    An, Sha
    Ziegler, Karl Ferdinand
    Zhang, Peiyi
    Wang, Yu
    Kwok, Tim
    Xu, Fan
    Bi, Cheng
    Matosevic, Sandro
    Yin, Peng
    Li, Tongcang
    Huang, Fang
    [J]. BIOMEDICAL OPTICS EXPRESS, 2020, 11 (01): : 461 - 479
  • [50] A comparative study of super-resolution algorithms for video streaming application
    He, Xiaonan
    Qiao, Yuansong
    Lee, Brian
    Ye, Yuhang
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 83 (14) : 43493 - 43512