CONTEXT-AWARE GRAPH-BASED SELF-SUPERVISED LEARNING OF WHOLE SLIDE IMAGES

被引:2
|
作者
Aryal, Milan [1 ]
Soltani, Nasim Yahya [1 ]
机构
[1] Marquette Univ, Dept Comp Sci, Milwaukee, WI 53233 USA
关键词
Self-supervised learning; whole slide image; graph convolutional networks; computational pathology;
D O I
10.1109/ICASSP43922.2022.9747899
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
The gigapixel resolution of a single whole slide image (WSI), and the lack of huge annotated datasets needed for computational pathology, makes cancer diagnosis and grading with WSIs a challenging task. Moreover, downsampling of WSIs might result in loss of information critical for cancer diagnosis. Motivated by the fact that context such as topological structures in the tumor environment may contain critical information in cancer grading and diagnosis, a novel twostage learning approach is proposed. Self-supervised learning is applied to improve training through unlabled data and graph convolutional network (GCN) is deployed to incorporate context from tumor and surrounding tissues. More specifically, we represent the whole slide as a graph, where nodes are patches from the WSIs. The patches in the graph are represented as feature vectors obtained from pre-training the patches in self-supervised learning. The graph is trained using GCN which accounts for the context of each tissue for the cancer grading and classification. In this work, WSIs for prostrate cancer are validated and the model performance is evaluated based on diagnosis and grading of prostrate cancer and compared with ResNet50 as a traditional convolutional neural network (CNN) and multi-instance learning (MIL) as a leading approach in WSI diagnosis.
引用
收藏
页码:3553 / 3557
页数:5
相关论文
共 50 条
  • [1] Context Matters: Graph-based Self-supervised Representation Learning for Medical Images
    Li Sun
    Yu, Ke
    Batmanghelich, Kayhan
    [J]. THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 4874 - 4882
  • [2] Self-supervised Heterogeneous Hypergraph Learning with Context-aware Pooling for Graph-level Classification
    Hayat, Malik Khizar
    Xue, Shan
    Yang, Jian
    [J]. 23RD IEEE INTERNATIONAL CONFERENCE ON DATA MINING, ICDM 2023, 2023, : 140 - 149
  • [3] Cancer Survival Prediction From Whole Slide Images With Self-Supervised Learning and Slide Consistency
    Fan, Lei
    Sowmya, Arcot
    Meijering, Erik
    Song, Yang
    [J]. IEEE TRANSACTIONS ON MEDICAL IMAGING, 2023, 42 (05) : 1401 - 1412
  • [4] A Self-Supervised Learning Based Framework for Eyelid Malignant Melanoma Diagnosis in Whole Slide Images
    Jiang, Zijing
    Wang, Linyan
    Wang, Yaqi
    Jia, Gangyong
    Zeng, Guodong
    Wang, Jun
    Li, Yunxiang
    Chen, Dechao
    Qian, Guiping
    Jin, Qun
    [J]. IEEE-ACM TRANSACTIONS ON COMPUTATIONAL BIOLOGY AND BIOINFORMATICS, 2024, 21 (04) : 701 - 714
  • [5] CAiD: Context-Aware Instance Discrimination for Self-supervised Learning in Medical Imaging
    Taher, Mohammad Reza Hosseinzadeh
    Haghighi, Fatemeh
    Gotway, Michael B.
    Liang, Jianming
    [J]. INTERNATIONAL CONFERENCE ON MEDICAL IMAGING WITH DEEP LEARNING, VOL 172, 2022, 172 : 535 - 551
  • [6] Graph-based context-aware collaborative filtering
    Tu Minh Phuong
    Do Thi Lien
    Nguyen Duy Phuong
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2019, 126 : 9 - 19
  • [7] A deep learning framework for context-aware mitotic activity estimation in whole slide images
    Pati, Pushpak
    Catena, Raul
    Goksel, Orcun
    Gabrani, Maria
    [J]. MEDICAL IMAGING 2019: DIGITAL PATHOLOGY, 2019, 10956
  • [8] Self-Supervised Image Denoising for Real-World Images With Context-Aware Transformer
    Zhang, Dan
    Zhou, Fangfang
    [J]. IEEE ACCESS, 2023, 11 : 14340 - 14349
  • [9] Grading of Prostate Whole-slide Images Using Weak Self-supervised Learning
    Ghorbani, Amirata
    Esteva, Andre
    Zou, James
    [J]. 2022 56TH ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS, AND COMPUTERS, 2022, : 1439 - 1443
  • [10] Fast and scalable search of whole-slide images via self-supervised deep learning
    Chengkuan Chen
    Ming Y. Lu
    Drew F. K. Williamson
    Tiffany Y. Chen
    Andrew J. Schaumberg
    Faisal Mahmood
    [J]. Nature Biomedical Engineering, 2022, 6 : 1420 - 1434