Diffusion models for out-of-distribution detection in digital pathology

被引:0
|
作者
Linmans, Jasper [1 ]
Raya, Gabriel [2 ]
van der Laak, Jeroen [1 ,3 ]
Litjens, Geert [1 ]
机构
[1] Department of Pathology, RadboudUMC Graduate School, Radboud University Medical Center, Nijmegen, Netherlands
[2] Jheronimus Academy of Data Science, ’s-Hertogenbosch, Netherlands
[3] Center for Medical Image Science and Visualization, Linköping University, Linköping, Sweden
关键词
Unsupervised learning;
D O I
暂无
中图分类号
学科分类号
摘要
The ability to detect anomalies, i.e. anything not seen during training or out-of-distribution (OOD), in medical imaging applications is essential for successfully deploying machine learning systems. Filtering out OOD data using unsupervised learning is especially promising because it does not require costly annotations. A new class of models called AnoDDPMs, based on denoising diffusion probabilistic models (DDPMs), has recently achieved significant progress in unsupervised OOD detection. This work provides a benchmark for unsupervised OOD detection methods in digital pathology. By leveraging fast sampling techniques, we apply AnoDDPM on a large enough scale for whole-slide image analysis on the complete test set of the Camelyon16 challenge. Based on ROC analysis, we show that AnoDDPMs can detect OOD data with an AUC of up to 94.13 and 86.93 on two patch-level OOD detection tasks, outperforming the other unsupervised methods. We observe that AnoDDPMs alter the semantic properties of inputs, replacing anomalous data with more benign-looking tissue. Furthermore, we highlight the flexibility of AnoDDPM towards different information bottlenecks by evaluating reconstruction errors for inputs with different signal-to-noise ratios. While there is still a significant performance gap with fully supervised learning, AnoDDPMs show considerable promise in the field of OOD detection in digital pathology. © 2024 The Author(s)
引用
收藏
相关论文
共 50 条
  • [21] Understanding Failures in Out-of-Distribution Detection with Deep Generative Models
    Zhang, Lily H.
    Goldstein, Mark
    Ranganath, Rajesh
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 139, 2021, 139
  • [22] Out-of-Distribution Node Detection Based on Graph Heat Kernel Diffusion
    Li, Fangfang
    Wang, Yangshuai
    Du, Xinyu
    Li, Xiaohua
    Yu, Ge
    MATHEMATICS, 2024, 12 (18)
  • [23] Out-of-Distribution Detection for Automotive Perception
    Nitsch, Julia
    Itkina, Masha
    Senanayake, Ransalu
    Nieto, Juan
    Schmidt, Max
    Siegwart, Roland
    Kochenderfer, Mykel J.
    Cadena, Cesar
    2021 IEEE INTELLIGENT TRANSPORTATION SYSTEMS CONFERENCE (ITSC), 2021, : 2938 - 2943
  • [24] Decoupling MaxLogit for Out-of-Distribution Detection
    Zhang, Zihan
    Xiang, Xiang
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 3388 - 3397
  • [25] Out-of-distribution Detection via Frequency-regularized Generative Models
    Cai, Mu
    Li, Yixuan
    2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, : 5510 - 5519
  • [26] Robust Cough Detection With Out-of-Distribution Detection
    Chen, Yuhan
    Attri, Pankaj
    Barahona, Jeffrey
    Hernandez, Michelle L.
    Carpenter, Delesha
    Bozkurt, Alper
    Lobaton, Edgar
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2023, 27 (07) : 3210 - 3221
  • [27] Exploring the Limits of Out-of-Distribution Detection
    Fort, Stanislav
    Ren, Jie
    Lakshminarayanan, Balaji
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [28] An Empirical Evaluation of Out-of-Distribution Detection Using Pretrained Language Models
    Yoon, Byungmu
    Kim, Jaeyoung
    2023 5TH INTERNATIONAL CONFERENCE ON CONTROL AND ROBOTICS, ICCR, 2023, : 302 - 308
  • [29] On Risk Assessment for Out-of-Distribution Detection
    Vasiliuk, Anton
    IEEE ACCESS, 2025, 13 : 18546 - 18568
  • [30] Investigation of out-of-distribution detection across various models and training methodologies
    Kim, Byung Chun
    Kim, Byungro
    Hyun, Yoonsuk
    NEURAL NETWORKS, 2024, 175