Super-resolution recurrent convolutional neural networks for learning with multi-resolution whole slide images

被引:11
|
作者
Mukherjee, Lopamudra [1 ]
Bui, Huu Dat [1 ]
Keikhosravi, Adib [2 ]
Loeffler, Agnes [3 ]
Eliceiri, Kevin W. [2 ,4 ]
机构
[1] Univ Wisconsin, Dept Comp Sci, Whitewater, WI 53190 USA
[2] Univ Wisconsin, Dept Biomed Engn, Madison, WI USA
[3] Metrohlth Med Ctr, Dept Pathol, Cleveland, OH USA
[4] Morgridge Inst Res, Madison, WI USA
关键词
image super-resolution; convolutional neural networks; pathology; whole slide imaging; machine learning; PANCREATIC-CANCER; STROMAL BIOLOGY; DEEP; GRADE; CLASSIFICATION; CARCINOMA; OBJECT;
D O I
10.1117/1.JBO.24.12.126003
中图分类号
Q5 [生物化学];
学科分类号
071010 ; 081704 ;
摘要
We study a problem scenario of super-resolution (SR) algorithms in the context of whole slide imaging (WSI), a popular imaging modality in digital pathology. Instead of just one pair of high- and low-resolution images, which is typically the setup in which SR algorithms are designed, we are given multiple intermediate resolutions of the same image as well. The question remains how to best utilize such data to make the transformation learning problem inherent to SR more tractable and address the unique challenges that arises in this biomedical application. We propose a recurrent convolutional neural network model, to generate SR images from such multi-resolution WSI datasets. Specifically, we show that having such intermediate resolutions is highly effective in making the learning problem easily trainable and address large resolution difference in the low and high-resolution images common in WSI, even without the availability of a large size training data. Experimental results show state-of-the-art performance on three WSI histopathology cancer datasets, across a number of metrics. (C) The Authors. Published by SPIE under a Creative Commons Attribution 4.0 Unported License.
引用
收藏
页数:15
相关论文
共 50 条
  • [31] Enhancing Resolution of Digital Rock Images with Super Resolution Convolutional Neural Networks
    Wang, Ying Da
    Armstrong, Ryan T.
    Mostaghimi, Peyman
    [J]. JOURNAL OF PETROLEUM SCIENCE AND ENGINEERING, 2019, 182
  • [32] Single patch super-resolution of histopathology whole slide images: a comparative study
    Afshari, Mehdi
    Yasir, Saba
    Keeney, Gary L.
    Jimenez, Rafael E.
    Garcia, Joaquin J.
    Tizhoosh, Hamid R.
    [J]. JOURNAL OF MEDICAL IMAGING, 2023, 10 (01)
  • [33] Joint Super-resolution and Tissue Patch Classification for Whole Slide Histological Images
    Sun, Zh.
    Khvostikov, A.
    Krylov, A.
    Sethi, A.
    Mikhailov, I.
    Malkov, P.
    [J]. PROGRAMMING AND COMPUTER SOFTWARE, 2024, 50 (03) : 257 - 263
  • [34] COMPUTED TOMOGRAPHY SUPER-RESOLUTION USING CONVOLUTIONAL NEURAL NETWORKS
    Yu, Haichao
    Liu, Ding
    Shi, Honghui
    Yu, Hanchao
    Wang, Zhangyang
    Wang, Xinchao
    Cross, Brent
    Bramlet, Matthew
    Huang, Thomas S.
    [J]. 2017 24TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2017, : 3944 - 3948
  • [35] SUPER-RESOLUTION OF COMPRESSED VIDEOS USING CONVOLUTIONAL NEURAL NETWORKS
    Kappeler, Armin
    Yoo, Seunghwan
    Dai, Qiqin
    Katsaggelos, Aggelos K.
    [J]. 2016 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2016, : 1150 - 1154
  • [36] Super-Resolution PET Imaging Using Convolutional Neural Networks
    Song, Tzu-An
    Chowdhury, Samadrita Roy
    Yang, Fan
    Dutta, Joyita
    [J]. IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2020, 6 : 518 - 528
  • [37] Object Detection by a Super-Resolution Method and a Convolutional Neural Networks
    Na, Bokyoon
    Fox, Geoffrey C.
    [J]. 2018 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2018, : 2263 - 2269
  • [38] Orthoimage Super-Resolution via Deep Convolutional Neural Networks
    Berezovsky, Vladimir
    Bai, Yunfeng
    Sharshov, Ivan
    Aleshko, Roman
    Shoshina, Kseniya
    Vasendina, Irina
    [J]. 2022 IEEE 20TH INTERNATIONAL CONFERENCE ON INDUSTRIAL INFORMATICS (INDIN), 2022, : 263 - 268
  • [39] IMAGE SUPER-RESOLUTION USING MULTI-RESOLUTION ATTENTION NETWORK
    Liu, Anqi
    Li, Sumei
    Chang, Yongli
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 1610 - 1614
  • [40] GRAPH-BASED MULTI-RESOLUTION SEGMENTATION OF HISTOLOGICAL WHOLE SLIDE IMAGES
    Roullier, V.
    Ta, V-T.
    Lezoray, O.
    Elmoataz, A.
    [J]. 2010 7TH IEEE INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING: FROM NANO TO MACRO, 2010, : 153 - 156