Super-resolution recurrent convolutional neural networks for learning with multi-resolution whole slide images

被引:11
|
作者
Mukherjee, Lopamudra [1 ]
Bui, Huu Dat [1 ]
Keikhosravi, Adib [2 ]
Loeffler, Agnes [3 ]
Eliceiri, Kevin W. [2 ,4 ]
机构
[1] Univ Wisconsin, Dept Comp Sci, Whitewater, WI 53190 USA
[2] Univ Wisconsin, Dept Biomed Engn, Madison, WI USA
[3] Metrohlth Med Ctr, Dept Pathol, Cleveland, OH USA
[4] Morgridge Inst Res, Madison, WI USA
关键词
image super-resolution; convolutional neural networks; pathology; whole slide imaging; machine learning; PANCREATIC-CANCER; STROMAL BIOLOGY; DEEP; GRADE; CLASSIFICATION; CARCINOMA; OBJECT;
D O I
10.1117/1.JBO.24.12.126003
中图分类号
Q5 [生物化学];
学科分类号
071010 ; 081704 ;
摘要
We study a problem scenario of super-resolution (SR) algorithms in the context of whole slide imaging (WSI), a popular imaging modality in digital pathology. Instead of just one pair of high- and low-resolution images, which is typically the setup in which SR algorithms are designed, we are given multiple intermediate resolutions of the same image as well. The question remains how to best utilize such data to make the transformation learning problem inherent to SR more tractable and address the unique challenges that arises in this biomedical application. We propose a recurrent convolutional neural network model, to generate SR images from such multi-resolution WSI datasets. Specifically, we show that having such intermediate resolutions is highly effective in making the learning problem easily trainable and address large resolution difference in the low and high-resolution images common in WSI, even without the availability of a large size training data. Experimental results show state-of-the-art performance on three WSI histopathology cancer datasets, across a number of metrics. (C) The Authors. Published by SPIE under a Creative Commons Attribution 4.0 Unported License.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] HookNet: Multi-resolution convolutional neural networks for semantic segmentation in histopathology whole-slide images
    van Rijthoven, Mart
    Balkenhol, Maschenka
    Silina, Karina
    van der Laak, Jeroen
    Ciompi, Francesco
    [J]. MEDICAL IMAGE ANALYSIS, 2021, 68
  • [2] Multi-resolution Networks for Semantic Segmentation in Whole Slide Images
    Gu, Feng
    Burlutskiy, Nikolay
    Andersson, Mats
    Wilen, Lena Kajland
    [J]. COMPUTATIONAL PATHOLOGY AND OPHTHALMIC MEDICAL IMAGE ANALYSIS, 2018, 11039 : 11 - 18
  • [3] Multi-Resolution Convolutional Recurrent Networks
    Chien, Jen-Tzung
    Huang, Yu-Min
    [J]. 2021 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA ASC), 2021, : 2043 - 2048
  • [4] Super-resolution with multi-path convolutional neural networks
    Urazoe, Kazuya
    Kuroki, Nobutaka
    Kato, Yu
    Ohtani, Shinya
    Hirose, Tetsuya
    Numa, Masahiro
    [J]. IEEJ Transactions on Electronics, Information and Systems, 2020, 140 (06): : 638 - 650
  • [5] Super-Resolution on Degraded Low-Resolution Images Using Convolutional Neural Networks
    Albluwi, Fatma
    Krylov, Vladimir A.
    Dahyot, Rozenn
    [J]. 2019 27TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO), 2019,
  • [6] Super-Resolution of Color Halftone Images Using Convolutional Neural Networks
    Novaes, Guilherme Apolinario Silva
    Kim, Hae Yong
    [J]. IEEE ACCESS, 2024, 12 : 9082 - 9096
  • [7] Video Super-Resolution With Convolutional Neural Networks
    Kappeler, Armin
    Yoo, Seunghwan
    Dai, Qiqin
    Katsaggelos, Aggelos K.
    [J]. IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2016, 2 (02) : 109 - 122
  • [8] Bidirectional Recurrent Convolutional Networks for Multi-Frame Super-Resolution
    Huang, Yan
    Wang, Wei
    Wang, Liang
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 28 (NIPS 2015), 2015, 28
  • [9] Super-resolution method for MR images based on multi-resolution CNN
    Kang, Li
    Liu, Guojuan
    Huang, Jianjun
    Li, Jianping
    [J]. BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2022, 72
  • [10] Multi-Channel Convolutional Neural Networks for Image Super-Resolution
    Ohtani, Shinya
    Kato, Yu
    Kuroki, Nobutaka
    Hirose, Tetsuya
    Numa, Masahiro
    [J]. IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS COMMUNICATIONS AND COMPUTER SCIENCES, 2017, E100A (02) : 572 - 580